-- Logs begin at Tue 2022-07-05 09:24:59 UTC, end at Tue 2022-07-05 10:27:31 UTC. -- Jul 05 10:00:31.878214 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 05 10:00:31.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 05 10:00:31.887894 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 10:00:31 2022] *** Jul 05 10:00:31.887894 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 10:00:31.887894 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 10:00:31.887894 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: nodename: dv-osbrick-master-4-iscsi Jul 05 10:00:31.887894 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: machine: x86_64 Jul 05 10:00:31.887894 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: clock source: unix Jul 05 10:00:31.887894 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: pcre jit disabled Jul 05 10:00:31.888333 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: detected number of CPU cores: 4 Jul 05 10:00:31.888333 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: current working directory: / Jul 05 10:00:31.888333 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: detected binary path: /usr/bin/uwsgi-core Jul 05 10:00:31.888333 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: your processes number limit is 47680 Jul 05 10:00:31.888333 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: your memory page size is 4096 bytes Jul 05 10:00:31.888333 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: detected max file descriptor number: 2048 Jul 05 10:00:31.888333 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: lock engine: pthread robust mutexes Jul 05 10:00:31.888333 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: thunder lock: enabled Jul 05 10:00:31.888333 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 05 10:00:31.888333 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 10:00:31.933358 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: Python main interpreter initialized at 0x565102da39c0 Jul 05 10:00:31.933358 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: python threads support enabled Jul 05 10:00:31.933358 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: your server socket listen backlog is limited to 100 connections Jul 05 10:00:31.933358 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: your mercy for graceful operations on workers is 90 seconds Jul 05 10:00:31.933726 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 10:00:31.933824 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: *** Operational MODE: preforking *** Jul 05 10:00:31.934095 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: *** uWSGI is running in multiple interpreter mode *** Jul 05 10:00:31.934095 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: spawned uWSGI master process (pid: 80348) Jul 05 10:00:31.934298 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 05 10:00:31.935237 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: spawned uWSGI worker 1 (pid: 80360, cores: 1) Jul 05 10:00:31.935237 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: spawned uWSGI worker 2 (pid: 80361, cores: 1) Jul 05 10:00:31.935384 dv-osbrick-master-4-iscsi devstack@keystone.service[80348]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 10:00:37.331204 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:00:37.331204 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: from cryptography.utils import int_from_bytes Jul 05 10:00:37.331888 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:00:37.331888 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: from cryptography.utils import int_from_bytes Jul 05 10:00:37.332021 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:00:37.332021 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: from cryptography.utils import int_from_bytes Jul 05 10:00:37.332437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:00:37.332437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: from cryptography.utils import int_from_bytes Jul 05 10:00:37.380737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 10:00:37.380980 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 10:00:37.381172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 10:00:37.381277 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] command line args: [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 10:00:37.381419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 10:00:37.381557 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 10:00:37.381645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] command line args: [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 10:00:37.381719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ================================================================================ {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 10:00:37.381890 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 10:00:37.381976 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] admin_token = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.382074 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ================================================================================ {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 10:00:37.382257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] config_dir = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.382334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] admin_token = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.382489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.382567 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] config_dir = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.382710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] config_source = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.382786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.382927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] config_source = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.383009 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] debug = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.383111 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] debug = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.383188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.383390 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.383534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.383610 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.383710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.383787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.383964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.384048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.384371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.384478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.384545 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.384603 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.384667 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] log_config_append = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.384730 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_config_append = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.384787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.384843 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.384981 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] log_dir = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.385074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_dir = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.385151 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_file = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.385217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] log_file = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.385391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.385489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.385625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.385703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.385874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.385958 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.386126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.386220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.386300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.386371 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.386473 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.386602 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.386719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.386823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.386968 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.387077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.387201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.387283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.387435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.387507 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.387668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.387774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.387901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.388010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.388168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.388254 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.388389 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.388472 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.388666 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.388743 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.389182 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.389280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.389364 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] publish_errors = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.389439 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] publish_errors = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.389590 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.389682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.389822 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.389897 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.390002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.390076 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.390254 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.390379 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.390490 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.390566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.390728 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] standard_threads = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.390806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] standard_threads = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.390966 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.391043 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.391212 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.391293 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.391389 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.391464 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.391567 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] use_journal = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.391642 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] use_journal = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.391742 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] use_json = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.391822 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] use_json = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.391917 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] use_stderr = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.392000 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] use_stderr = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.392111 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] use_syslog = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.392230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] use_syslog = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.392310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.392422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:00:37.392576 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.392659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.392815 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.392903 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.393112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.393188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.393355 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.393444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.393608 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.393695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.393849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.393924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.394099 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.394182 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.394337 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.394419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.394587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.394661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.394836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.394921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.395087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.395162 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.395322 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.395403 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.395570 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.395657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.395808 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.395888 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.396057 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.396131 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.396305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.396455 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.396534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.396603 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.396792 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.397409 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.397599 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.397683 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.397851 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.397926 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.398093 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.398167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.398351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.398437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.398625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.398885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.398966 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.399139 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.399223 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.399375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.399451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.399611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.399692 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.399845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.400084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.400160 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.400335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.400412 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.400588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.400666 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.400820 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.400944 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.401086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.401172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.401337 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.401412 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.401586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.401660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.401826 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.401900 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.402080 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.402195 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.402316 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.402411 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.402553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.402634 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.402781 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.402853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.403014 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.403096 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.403247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.403320 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.403478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.403554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.403712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.403792 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.403952 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.404056 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.404206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.404314 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.404441 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.404552 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.404816 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.404937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.405051 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.405148 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.405241 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.405338 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.405445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.405539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.405640 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.405782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.405910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.406028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.406151 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.406322 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.406456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.406578 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.406708 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.406828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.406948 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.407077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.407206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.407338 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.407464 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.407585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.407703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.407833 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.407971 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.408102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.408223 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.408354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.408480 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.408608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.408739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.408862 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.409015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.409093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.409207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.409288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.409360 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.409480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.409563 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.409636 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.409755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.409831 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.409900 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.410014 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.410096 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.410191 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.410297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.410440 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.410540 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.410682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.410782 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.410923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.411027 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.411163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.411278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.411414 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.411520 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.411656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.411762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.411896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.412009 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.412142 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.412251 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.412382 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.412593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.413216 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.413318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.413562 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.413732 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.413809 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.413981 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.414059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.414222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.414307 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.414489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.414566 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.414733 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.414811 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.414977 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.415126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.415201 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.415278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.415444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.415520 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.415681 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.415768 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.415912 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.416000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.416149 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.416226 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.416381 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.416462 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.416615 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.416700 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.416850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.416947 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.417115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.417193 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.417348 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.417439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.417591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.417669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.417830 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.417913 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.418080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.418166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.418319 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.418397 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.418573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.418923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.419091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.external = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.419176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.419327 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.419403 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.419583 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.external = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.419659 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.419820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.419927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.420079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.password = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.420164 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.420315 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] auth.token = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.420393 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.420560 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.420642 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.password = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.420792 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.token = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.420870 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.421059 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.421138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.421300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.421377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.421550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.421628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.421782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.421858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.422024 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.422100 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.422264 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.422343 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.422496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.422573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.422742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.422820 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.422994 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.423072 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.423232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.423307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.423481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.423558 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.423718 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.423796 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.423965 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.424043 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.424204 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.424281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.424459 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.424543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.424715 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.424791 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.424976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.425058 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.425237 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.425317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.425517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.425594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.425764 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.425843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.426028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.426107 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.426270 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.426355 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.426511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.426588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.426758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.426835 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.427000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.427078 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.427236 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.427312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.427490 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.427568 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.427725 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.427803 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.427978 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.428057 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.428242 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.428320 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.428502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.428580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.428740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.428819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.429013 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.429092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.429252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.429328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.429503 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.429757 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.429907 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.429983 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.430053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.430227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.430305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.430478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.430557 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.430713 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.430792 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.430960 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.431037 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.431214 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.431293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.431466 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.431543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.431691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.431767 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.431927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.432006 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.432161 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.432238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.432411 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.432488 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.432650 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.432727 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.432942 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.433024 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.433161 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.433238 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.433420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.433498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.433665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.433742 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.433920 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.433996 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.434163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.434241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.434399 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.434482 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.434640 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.434718 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.434876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.434955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.435114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.435191 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.435355 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.435430 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.435591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.435670 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.435831 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.435908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.436063 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.436139 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.436309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.436393 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.436564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.436641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.436801 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.436878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.437077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.437158 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.437328 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.437404 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.437563 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.437639 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.437805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.437884 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.438040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.438117 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.438278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.438355 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.438517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.438602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.438750 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.438827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.438990 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.439066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.439229 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.439308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.439474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.439553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.439715 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.439793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.439949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.440026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.440183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.440261 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.440435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.440512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.440667 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.440745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.440933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.441014 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.441169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.441247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.441409 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.441488 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.441644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.441721 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.441882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.441959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.442122 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.442201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.442355 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.442434 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.442603 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.442687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.442853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.442931 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.443087 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.443170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.443329 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.443413 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.443562 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.443640 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.443825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.443902 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.444064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.444148 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.444296 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.444372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.444526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.444602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.444761 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.444845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.445025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.445104 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.445259 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.445339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.445512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.445759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.445836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.445993 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.446070 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.446241 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.446327 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.446483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.446561 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.446720 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.446798 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.446958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.447043 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.447197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.447274 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.447438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.447516 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.447679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.447764 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.447917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.447996 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.448163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.448239 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.448396 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.448479 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.448644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.448721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.448881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.449013 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.449143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.449232 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.449383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.449461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.449622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.449699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.449863 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.449949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.450093 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.450177 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.450332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.450410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.450574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.450658 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.450811 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.450889 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.451052 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.451129 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.451296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.451380 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.451545 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.451622 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.451795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.451872 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.452031 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.452116 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.452277 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.452353 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.452516 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.452593 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.452759 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.452928 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.453004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] role.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.453072 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.453258 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] role.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.453336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.453499 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.453624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.453734 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] role.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.453814 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.453983 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] role.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.454063 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.454219 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.454308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.454469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.454547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.454718 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.454796 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.454964 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.455050 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.455213 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.455291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.455461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.455538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.455696 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.455777 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.455942 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.456020 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.456188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.456266 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.456420 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.456499 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.456672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.456750 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.456948 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.457091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.457204 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.457333 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.457453 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.457588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.457843 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.457920 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.458081 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.458161 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.458331 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.458408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.458568 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.458646 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.458823 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.458903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.459074 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.459151 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.459823 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.459908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.460072 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.460152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.460308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.460385 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.460543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.460621 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.460788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.460866 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.461050 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.461129 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.461288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.461379 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.461538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.461625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.461778 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.461856 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.462013 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.462102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.462253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.462332 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.462490 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.462567 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.462731 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.462817 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.462972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.463048 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] token.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.463210 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.463293 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.463488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.463719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.463937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.464063 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.464201 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.464330 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.464457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.464590 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.464715 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.464840 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.464982 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.465233 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.465366 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.465494 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.465619 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.465743 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.465868 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.466005 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.466137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.466263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.466388 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.466388 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.466624 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.466746 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.466879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.connection = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.467011 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.467148 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.467274 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.467400 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.467526 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.467652 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.467652 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.467903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.468029 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.468154 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.connection = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.468288 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.468421 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.468548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.468674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.468812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.468979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.469100 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.469225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.469350 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.469476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.469620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.469746 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.469871 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.469995 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.470119 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.470244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.470376 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.470502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.470627 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.470753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.470877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.471002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.471132 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.471266 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.471391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.471516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.471641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 10:00:37.471768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.471768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.471768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.471768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.472230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:00:37.472230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 10:00:37.501654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.501875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.502003 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.502138 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.502280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.502406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.510370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.510507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.539014 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.539241 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.539801 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.540037 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.680756 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.681396 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.730079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.730319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.730742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.730984 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.793593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.794042 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.794175 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.794317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.794445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.794581 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.794708 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.794832 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.794956 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.795088 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.795213 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.795338 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.819010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.819242 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.819475 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.819602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.819744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.819869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.819992 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.820123 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.820252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.820380 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.820508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.820635 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.820635 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.820884 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.831235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.831722 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.843809 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.844042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.844270 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.844457 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.844584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.844708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.844831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.845027 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.845157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.845157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80360) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.845412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.845412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.845653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.845788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 10:00:37.862827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.863039 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 10:00:37.863272 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.863399 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.863536 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 10:00:37.863661 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 10:00:37.863822 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.864034 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.864159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.864282 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 10:00:37.864413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.864536 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.864659 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.865035 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.865294 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.875934 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.876214 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.876481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.876695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.876821 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.877002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.877274 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.877558 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.885047 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.885851 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.888316 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.888600 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.888883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.889157 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.889283 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.889441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.889566 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.889694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.889821 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.889971 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.890105 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.890234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.890361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.890501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.890628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.890755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.890890 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.891018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.891147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.891274 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.891539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.891832 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.917941 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.919425 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.919814 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.920094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.921066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.921351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.925362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.925649 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.926044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.926601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.926885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.927165 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.933930 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.934175 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.935127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.935412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.938630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.939204 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.939487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.939764 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.939890 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.940041 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.940176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.940300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.940430 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.940564 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.940689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.940996 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.941277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.941548 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.941814 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.959146 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.959942 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.960916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.961205 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.964614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.965837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.968261 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.968558 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.969505 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.969805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.973680 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.975012 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.977867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.979143 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:37.981527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.981830 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.982118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.982413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.982710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.982834 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.982993 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.983119 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.983366 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.983667 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.983949 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:37.984238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.001991 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.002278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.002547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.002839 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.003354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.003642 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.003914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.004180 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.010746 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.012117 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.012433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.012711 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.013858 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.014140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.015921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.016203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.016484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.016768 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.017195 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.017394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.017679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.017980 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.018273 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.018551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.030958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.031241 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.031526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.031809 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.032087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.032556 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.032840 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.033148 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.033433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.033669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.033796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.033973 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.034098 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.034292 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.052573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.054312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.055910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.057950 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.059206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.060965 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.061291 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.062606 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.062887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.063014 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.063173 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.064654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.064963 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.065263 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.070588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.072195 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.072664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.074294 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.075451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.075745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.076138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.076421 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.077554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.077861 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.078151 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.078432 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.086060 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.086352 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.086634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.088181 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.088473 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.088758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.094480 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80360) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.094759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.095040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.095318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.095594 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.095973 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.096261 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.096542 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.096677 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 10:00:38.096803 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.096954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.097088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.097220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.097359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.097488 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.097623 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.097755 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.097934 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.098064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.098193 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80360) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.098321 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.098496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.098876 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.099164 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.099445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.099710 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.100596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.100876 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 10:00:38.136346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x565102da39c0 pid: 80360 (default app) Jul 05 10:00:38.138666 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x565102da39c0 pid: 80361 (default app) Jul 05 10:00:38.139712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee38750-f52e-44d4-a36c-56279f76d0fa None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:38.140006 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee38750-f52e-44d4-a36c-56279f76d0fa None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:38.140290 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee38750-f52e-44d4-a36c-56279f76d0fa None None] PATH_INFO: `/v3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:38.144529 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Tue Jul 5 10:00:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:00:45.724218 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf46be-0fac-4e08-9979-c4fab4bb6809 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:45.725288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf46be-0fac-4e08-9979-c4fab4bb6809 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:45.725288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf46be-0fac-4e08-9979-c4fab4bb6809 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:45.729653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:00:45.734745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beefa5-df19-4823-be15-3461b5bdeee4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:45.735152 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beefa5-df19-4823-be15-3461b5bdeee4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:45.735317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beefa5-df19-4823-be15-3461b5bdeee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:45.803224 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: INFO dbcounter [None req-09beefa5-df19-4823-be15-3461b5bdeee4 None None] Registered counter for database keystone Jul 05 10:00:45.824416 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG oslo_db.sqlalchemy.engines [None req-09beefa5-df19-4823-be15-3461b5bdeee4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:00:45.830557 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writer thread running {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:00:46.006525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG passlib.handlers.bcrypt [None req-09beefa5-df19-4823-be15-3461b5bdeee4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80360) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 10:00:46.006941 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG passlib.handlers.bcrypt [None req-09beefa5-df19-4823-be15-3461b5bdeee4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80360) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 10:00:46.062099 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-09beefa5-df19-4823-be15-3461b5bdeee4 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:46.063729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-09beefa5-df19-4823-be15-3461b5bdeee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:46.184078 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 10:00:46.373376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf46be-0fac-4e08-9979-c4fab4bb6809 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:46.444092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: INFO dbcounter [None req-f1cf46be-0fac-4e08-9979-c4fab4bb6809 None None] Registered counter for database keystone Jul 05 10:00:46.462880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG oslo_db.sqlalchemy.engines [None req-f1cf46be-0fac-4e08-9979-c4fab4bb6809 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:00:46.468952 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writer thread running {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:00:46.586607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf46be-0fac-4e08-9979-c4fab4bb6809 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:46.590813 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197d602-40d0-4d70-89d3-4d740c7af202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:46.591469 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197d602-40d0-4d70-89d3-4d740c7af202 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:46.591757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197d602-40d0-4d70-89d3-4d740c7af202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:46.592038 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197d602-40d0-4d70-89d3-4d740c7af202 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:46.600536 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197d602-40d0-4d70-89d3-4d740c7af202 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:46.651621 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e197d602-40d0-4d70-89d3-4d740c7af202 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 10:00:46.651968 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197d602-40d0-4d70-89d3-4d740c7af202 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:46.661380 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Tue Jul 5 10:00:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 10:00:46.667930 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09beefa5-df19-4823-be15-3461b5bdeee4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:46.683271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09beefa5-df19-4823-be15-3461b5bdeee4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:46.687649 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94855e74-c83b-41d7-9b84-8f9ee0fabf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:46.688773 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855e74-c83b-41d7-9b84-8f9ee0fabf81 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:46.689091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855e74-c83b-41d7-9b84-8f9ee0fabf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:46.689374 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855e74-c83b-41d7-9b84-8f9ee0fabf81 admin admin] PATH_INFO: `/v3/projects/67c453797fe3453cabef5a606e310eef` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:46.690857 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94855e74-c83b-41d7-9b84-8f9ee0fabf81 admin admin] RBAC: Authorizing `identity:get_project(project_id=67c453797fe3453cabef5a606e310eef)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:46.743883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: WARNING keystone.common.rbac_enforcer.enforcer [None req-94855e74-c83b-41d7-9b84-8f9ee0fabf81 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 10:00:46.744419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94855e74-c83b-41d7-9b84-8f9ee0fabf81 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:46.748785 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Tue Jul 5 10:00:46 2022] GET /identity/v3/projects/67c453797fe3453cabef5a606e310eef => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:00:48.768674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38299b6-b963-4969-bdcf-35c7bbe3e5fa None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:48.769223 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38299b6-b963-4969-bdcf-35c7bbe3e5fa None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:48.769319 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38299b6-b963-4969-bdcf-35c7bbe3e5fa None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:48.773458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:00:48.778858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d974b-5ff1-46df-aa58-0ca1a82739cd None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:48.779259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d974b-5ff1-46df-aa58-0ca1a82739cd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:48.779431 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d974b-5ff1-46df-aa58-0ca1a82739cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:48.798430 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-816d974b-5ff1-46df-aa58-0ca1a82739cd None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:48.799965 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-816d974b-5ff1-46df-aa58-0ca1a82739cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:48.808474 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 10:00:48.831092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38299b6-b963-4969-bdcf-35c7bbe3e5fa None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:48.843077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38299b6-b963-4969-bdcf-35c7bbe3e5fa None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:48.847665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e1a4-3580-40c6-b807-c2fb811d0fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:48.848303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e1a4-3580-40c6-b807-c2fb811d0fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:48.848588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e1a4-3580-40c6-b807-c2fb811d0fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:48.848863 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e1a4-3580-40c6-b807-c2fb811d0fdb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:48.857054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e1a4-3580-40c6-b807-c2fb811d0fdb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:48.858825 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e1a4-3580-40c6-b807-c2fb811d0fdb admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:48.868487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Tue Jul 5 10:00:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 10:00:48.873788 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d974b-5ff1-46df-aa58-0ca1a82739cd None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:48.882795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d974b-5ff1-46df-aa58-0ca1a82739cd None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:48.888048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97043bd-76d8-4f64-b4ed-81eabb83ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:48.888931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97043bd-76d8-4f64-b4ed-81eabb83ab20 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:48.889224 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97043bd-76d8-4f64-b4ed-81eabb83ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:48.889504 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97043bd-76d8-4f64-b4ed-81eabb83ab20 admin admin] PATH_INFO: `/v3/users/88fb21474f844e15aceece6e67aa28d0` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:48.890898 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97043bd-76d8-4f64-b4ed-81eabb83ab20 admin admin] RBAC: Authorizing `identity:get_user(user_id=88fb21474f844e15aceece6e67aa28d0)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:48.892719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97043bd-76d8-4f64-b4ed-81eabb83ab20 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:48.894326 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Tue Jul 5 10:00:48 2022] GET /identity/v3/users/88fb21474f844e15aceece6e67aa28d0 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:00:50.967054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f625ed-a656-46df-9acd-7f72ea065d66 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:50.967592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f625ed-a656-46df-9acd-7f72ea065d66 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:50.967685 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f625ed-a656-46df-9acd-7f72ea065d66 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:50.969084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:00:50.974281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4dce8-e2a2-4ad3-be51-1a31cdfcf120 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:50.974722 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4dce8-e2a2-4ad3-be51-1a31cdfcf120 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:50.974989 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4dce8-e2a2-4ad3-be51-1a31cdfcf120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:50.993232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0fa4dce8-e2a2-4ad3-be51-1a31cdfcf120 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:50.994686 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0fa4dce8-e2a2-4ad3-be51-1a31cdfcf120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:51.021307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a969b-16e7-4d42-97fd-cd16af05233f None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:51.021818 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a969b-16e7-4d42-97fd-cd16af05233f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:51.022113 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a969b-16e7-4d42-97fd-cd16af05233f None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:51.023662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:00:51.029066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26d83-39ae-4498-83a4-bf3754f0594c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:51.029360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26d83-39ae-4498-83a4-bf3754f0594c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:51.029650 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26d83-39ae-4498-83a4-bf3754f0594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:51.070614 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG passlib.handlers.bcrypt [None req-99a26d83-39ae-4498-83a4-bf3754f0594c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80361) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 10:00:51.071147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG passlib.handlers.bcrypt [None req-99a26d83-39ae-4498-83a4-bf3754f0594c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80361) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 10:00:51.079867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:00:51.103322 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4dce8-e2a2-4ad3-be51-1a31cdfcf120 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:51.117976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-99a26d83-39ae-4498-83a4-bf3754f0594c None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:51.119573 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-99a26d83-39ae-4498-83a4-bf3754f0594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:51.129245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:51.211975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4dce8-e2a2-4ad3-be51-1a31cdfcf120 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:51.222430 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:00:51.249859 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26d83-39ae-4498-83a4-bf3754f0594c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:51.253665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf19d9-3d6b-4d47-bad2-988530127bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:51.254523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf19d9-3d6b-4d47-bad2-988530127bef None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:51.254816 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf19d9-3d6b-4d47-bad2-988530127bef None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:51.255098 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf19d9-3d6b-4d47-bad2-988530127bef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:51.266661 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf19d9-3d6b-4d47-bad2-988530127bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-9bdf19d9-3d6b-4d47-bad2-988530127bef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:00:51.278176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:00:51.279084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:00:51.279881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:00:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:00:51.285453 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf19d9-3d6b-4d47-bad2-988530127bef None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:51.352170 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26d83-39ae-4498-83a4-bf3754f0594c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:51.354463 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:51.370551 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:51.388649 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf19d9-3d6b-4d47-bad2-988530127bef None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:51.392684 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96995ca7-709c-48ab-baa1-5b04211ab4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:51.393629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96995ca7-709c-48ab-baa1-5b04211ab4bf None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:51.393924 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96995ca7-709c-48ab-baa1-5b04211ab4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:51.394209 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96995ca7-709c-48ab-baa1-5b04211ab4bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:51.422838 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cad4c9-6926-4174-8a2f-5ebc568b01dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:51.423502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cad4c9-6926-4174-8a2f-5ebc568b01dd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:51.423786 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cad4c9-6926-4174-8a2f-5ebc568b01dd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:51.424064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cad4c9-6926-4174-8a2f-5ebc568b01dd None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:51.424811 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cad4c9-6926-4174-8a2f-5ebc568b01dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:00:51.425152 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cad4c9-6926-4174-8a2f-5ebc568b01dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:51.426548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cad4c9-6926-4174-8a2f-5ebc568b01dd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:51.438548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:00:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:00:51.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cad4c9-6926-4174-8a2f-5ebc568b01dd None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:51.461917 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96995ca7-709c-48ab-baa1-5b04211ab4bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:51.463447 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96995ca7-709c-48ab-baa1-5b04211ab4bf None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:51.543326 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cad4c9-6926-4174-8a2f-5ebc568b01dd None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:51.558472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:00:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 10:00:51.563901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96995ca7-709c-48ab-baa1-5b04211ab4bf None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:51.566555 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:51.576412 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ea466-aae5-4549-b65c-39e8cb3bfc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:51.577315 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea466-aae5-4549-b65c-39e8cb3bfc0e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:51.577604 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea466-aae5-4549-b65c-39e8cb3bfc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:51.577886 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea466-aae5-4549-b65c-39e8cb3bfc0e None admin] PATH_INFO: `/v3/users/88fb21474f844e15aceece6e67aa28d0` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:51.579095 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ea466-aae5-4549-b65c-39e8cb3bfc0e None admin] RBAC: Authorizing `identity:get_user(user_id=88fb21474f844e15aceece6e67aa28d0)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:51.580561 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ea466-aae5-4549-b65c-39e8cb3bfc0e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:51.582205 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:00:51 2022] GET /identity/v3/users/88fb21474f844e15aceece6e67aa28d0 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:00:51.587916 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ea466-aae5-4549-b65c-39e8cb3bfc0e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:51.602767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:51.673861 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96995ca7-709c-48ab-baa1-5b04211ab4bf None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:51.686909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ea466-aae5-4549-b65c-39e8cb3bfc0e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:51.707789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b3642-e5b6-4055-a8c2-3662ba561feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:51.710340 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b3642-e5b6-4055-a8c2-3662ba561feb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:51.710628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b3642-e5b6-4055-a8c2-3662ba561feb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:51.710905 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b3642-e5b6-4055-a8c2-3662ba561feb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:51.719404 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34fc08-6d4c-4345-b259-677e5739fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:51.720195 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fc08-6d4c-4345-b259-677e5739fac0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:51.720479 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fc08-6d4c-4345-b259-677e5739fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:51.720756 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34fc08-6d4c-4345-b259-677e5739fac0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:51.721961 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34fc08-6d4c-4345-b259-677e5739fac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:51.723409 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34fc08-6d4c-4345-b259-677e5739fac0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:51.725603 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:00:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:00:51.731207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34fc08-6d4c-4345-b259-677e5739fac0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:51.732263 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b3642-e5b6-4055-a8c2-3662ba561feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:51.733774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b3642-e5b6-4055-a8c2-3662ba561feb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d46b3642-e5b6-4055-a8c2-3662ba561feb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:00:51.756140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:00:51.757146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:00:51.757936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:00:51.757936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:00:51.757936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:00:51.757936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:00:51.757936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:00:51.764055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b3642-e5b6-4055-a8c2-3662ba561feb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:51.815520 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:51.821635 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:51.837301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34fc08-6d4c-4345-b259-677e5739fac0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:51.866779 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b3642-e5b6-4055-a8c2-3662ba561feb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:51.871401 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ee719-22e1-4338-8e8b-98a5478adb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:51.872056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ee719-22e1-4338-8e8b-98a5478adb9b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:51.872341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ee719-22e1-4338-8e8b-98a5478adb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:51.872619 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ee719-22e1-4338-8e8b-98a5478adb9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:51.873486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ee719-22e1-4338-8e8b-98a5478adb9b None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.domain.id=default, user.id=88fb21474f844e15aceece6e67aa28d0) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:00:51.873790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ee719-22e1-4338-8e8b-98a5478adb9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:51.875393 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ee719-22e1-4338-8e8b-98a5478adb9b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:51.882434 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1322 bytes} [Tue Jul 5 10:00:51 2022] GET /identity/v3/role_assignments?user.id=88fb21474f844e15aceece6e67aa28d0&scope.domain.id=default&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:00:51.901003 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16a568-2060-4db8-a8ba-1b5d76909bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:51.901702 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16a568-2060-4db8-a8ba-1b5d76909bdb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:51.901994 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16a568-2060-4db8-a8ba-1b5d76909bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:51.902278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16a568-2060-4db8-a8ba-1b5d76909bdb None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:51.903033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16a568-2060-4db8-a8ba-1b5d76909bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:00:51.903349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16a568-2060-4db8-a8ba-1b5d76909bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:51.904809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16a568-2060-4db8-a8ba-1b5d76909bdb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:51.924498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:00:53.992051 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a330a-6459-4077-aa72-83876f75e35d None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:53.993117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a330a-6459-4077-aa72-83876f75e35d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:53.993604 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a330a-6459-4077-aa72-83876f75e35d None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:53.995194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:00:54.000588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2620fb-c567-44d7-93d5-b829c1f8a8a4 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:54.001432 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2620fb-c567-44d7-93d5-b829c1f8a8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:54.001914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2620fb-c567-44d7-93d5-b829c1f8a8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:54.025477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-3d2620fb-c567-44d7-93d5-b829c1f8a8a4 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:54.027013 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3d2620fb-c567-44d7-93d5-b829c1f8a8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:54.108292 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:00:54.142652 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a330a-6459-4077-aa72-83876f75e35d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:54.276204 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a330a-6459-4077-aa72-83876f75e35d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:54.325654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992949-6207-4a66-b706-c15c5df93cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:54.326455 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992949-6207-4a66-b706-c15c5df93cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:54.326739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992949-6207-4a66-b706-c15c5df93cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:54.327014 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992949-6207-4a66-b706-c15c5df93cb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:54.347805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992949-6207-4a66-b706-c15c5df93cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-59992949-6207-4a66-b706-c15c5df93cb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:00:54.356074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:00:54.356875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:00:54.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:00:54.360942 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 13/24] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:00:54.364886 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2620fb-c567-44d7-93d5-b829c1f8a8a4 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:54.447857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:54.450490 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896234f3-4059-4dd5-af59-8643275249c9 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:54.450947 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896234f3-4059-4dd5-af59-8643275249c9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:54.451369 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896234f3-4059-4dd5-af59-8643275249c9 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:54.452879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 14/25] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:00:54.465003 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c772a-980f-4238-9c4e-d3d503eaf2c5 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:54.465505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c772a-980f-4238-9c4e-d3d503eaf2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:54.465926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c772a-980f-4238-9c4e-d3d503eaf2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:54.488299 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:54.517953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b96c772a-980f-4238-9c4e-d3d503eaf2c5 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:54.519175 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b96c772a-980f-4238-9c4e-d3d503eaf2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:54.530956 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2620fb-c567-44d7-93d5-b829c1f8a8a4 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:54.581672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0875c51-1dd6-4107-82bd-639a7cb7f5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:54.582367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0875c51-1dd6-4107-82bd-639a7cb7f5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:54.582661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0875c51-1dd6-4107-82bd-639a7cb7f5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:54.582949 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0875c51-1dd6-4107-82bd-639a7cb7f5f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:54.584224 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0875c51-1dd6-4107-82bd-639a7cb7f5f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:00:54.584556 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0875c51-1dd6-4107-82bd-639a7cb7f5f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:54.588364 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0875c51-1dd6-4107-82bd-639a7cb7f5f5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:54.608262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 12/26] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:00:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:00:54.610838 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473004e8-10ff-40b6-bf80-8390c7e63abc None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:54.612660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473004e8-10ff-40b6-bf80-8390c7e63abc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:54.613279 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473004e8-10ff-40b6-bf80-8390c7e63abc None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:54.616714 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:00:54.618161 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473004e8-10ff-40b6-bf80-8390c7e63abc None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:54.667528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 15/28] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:00:54.669520 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea728f9-fbd8-40b6-9f95-a41a34e2f26e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:54.670014 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea728f9-fbd8-40b6-9f95-a41a34e2f26e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:54.670468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea728f9-fbd8-40b6-9f95-a41a34e2f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:54.701188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2ea728f9-fbd8-40b6-9f95-a41a34e2f26e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:54.702408 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2ea728f9-fbd8-40b6-9f95-a41a34e2f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:54.781945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 16/29] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:00:54.782689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea728f9-fbd8-40b6-9f95-a41a34e2f26e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:54.852370 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473004e8-10ff-40b6-bf80-8390c7e63abc None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:54.877702 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:54.935083 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8239e8b-8192-491d-b248-fa2a612339a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:54.936172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:54.937939 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8239e8b-8192-491d-b248-fa2a612339a6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:54.939016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8239e8b-8192-491d-b248-fa2a612339a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:54.939581 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8239e8b-8192-491d-b248-fa2a612339a6 None admin] PATH_INFO: `/v3/users/88fb21474f844e15aceece6e67aa28d0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:54.944817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8239e8b-8192-491d-b248-fa2a612339a6 None admin] RBAC: Authorizing `identity:get_user(user_id=88fb21474f844e15aceece6e67aa28d0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:54.947198 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8239e8b-8192-491d-b248-fa2a612339a6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:54.949280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 14/30] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:00:54 2022] GET /identity/v3/users/88fb21474f844e15aceece6e67aa28d0 => generated 247 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:00:54.951274 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8239e8b-8192-491d-b248-fa2a612339a6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:55.032684 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea728f9-fbd8-40b6-9f95-a41a34e2f26e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:55.060654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8239e8b-8192-491d-b248-fa2a612339a6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:55.093260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a8715-33ff-4049-9744-8e232ba58de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:55.093945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a8715-33ff-4049-9744-8e232ba58de6 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:55.094213 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a8715-33ff-4049-9744-8e232ba58de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:55.094481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a8715-33ff-4049-9744-8e232ba58de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:55.095231 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a8715-33ff-4049-9744-8e232ba58de6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:55.096622 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a8715-33ff-4049-9744-8e232ba58de6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:55.104275 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f73c61-3396-437e-85c4-e12e3de8f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:55.105411 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f73c61-3396-437e-85c4-e12e3de8f009 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:55.105922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f73c61-3396-437e-85c4-e12e3de8f009 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:55.106434 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f73c61-3396-437e-85c4-e12e3de8f009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:55.118496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f73c61-3396-437e-85c4-e12e3de8f009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:55.120417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f73c61-3396-437e-85c4-e12e3de8f009 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-41f73c61-3396-437e-85c4-e12e3de8f009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:00:55.139150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:00:55.139954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:00:55.140735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:00:55.140735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:00:55.140735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:00:55.140735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:00:55.142631 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 15/31] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:00:55.143644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f73c61-3396-437e-85c4-e12e3de8f009 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:55.174696 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:55.234390 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 17/32] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Jul 5 10:00:54 2022] POST /identity/v3/roles => generated 219 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:00:55.236047 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0d86d-cf5c-4969-a1b5-f0283feb8b8f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:55.236591 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0d86d-cf5c-4969-a1b5-f0283feb8b8f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:55.236886 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0d86d-cf5c-4969-a1b5-f0283feb8b8f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:55.242819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 18/33] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:00:55.242819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0d86d-cf5c-4969-a1b5-f0283feb8b8f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:55.284914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f73c61-3396-437e-85c4-e12e3de8f009 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:55.365069 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe3300-1424-4bde-9d61-66bbaef9d811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:55.367306 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3300-1424-4bde-9d61-66bbaef9d811 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:55.368103 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3300-1424-4bde-9d61-66bbaef9d811 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:55.369358 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe3300-1424-4bde-9d61-66bbaef9d811 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:55.371240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe3300-1424-4bde-9d61-66bbaef9d811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:55.373181 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe3300-1424-4bde-9d61-66bbaef9d811 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:55.375033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 16/34] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:00:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:00:55.379657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7352a4-b1b0-4745-9468-da8af923f6cf None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:55.380257 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7352a4-b1b0-4745-9468-da8af923f6cf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:55.380843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7352a4-b1b0-4745-9468-da8af923f6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:55.413861 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-bc7352a4-b1b0-4745-9468-da8af923f6cf None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:55.415042 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bc7352a4-b1b0-4745-9468-da8af923f6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:55.459823 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0d86d-cf5c-4969-a1b5-f0283feb8b8f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:55.491699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:55.504020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 17/35] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:00:55.504670 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d47a1f-4bbb-42ff-b897-1b83fa7bba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:55.505694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47a1f-4bbb-42ff-b897-1b83fa7bba47 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:55.505864 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7352a4-b1b0-4745-9468-da8af923f6cf None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:55.506422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47a1f-4bbb-42ff-b897-1b83fa7bba47 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:55.506961 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d47a1f-4bbb-42ff-b897-1b83fa7bba47 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:55.508358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d47a1f-4bbb-42ff-b897-1b83fa7bba47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:00:55.509006 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d47a1f-4bbb-42ff-b897-1b83fa7bba47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:55.510802 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d47a1f-4bbb-42ff-b897-1b83fa7bba47 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:55.532043 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 19/36] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:00:55.538914 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d47a1f-4bbb-42ff-b897-1b83fa7bba47 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:55.545444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:55.621856 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7352a4-b1b0-4745-9468-da8af923f6cf None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:55.654113 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d47a1f-4bbb-42ff-b897-1b83fa7bba47 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:55.657441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ad9f2-8c4d-4ada-af8e-408eb7ccd945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:55.658395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ad9f2-8c4d-4ada-af8e-408eb7ccd945 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:55.658753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ad9f2-8c4d-4ada-af8e-408eb7ccd945 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:55.659104 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ad9f2-8c4d-4ada-af8e-408eb7ccd945 None admin] PATH_INFO: `/v3/domains/default/users/88fb21474f844e15aceece6e67aa28d0/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:55.661200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ad9f2-8c4d-4ada-af8e-408eb7ccd945 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=88fb21474f844e15aceece6e67aa28d0, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:55.662770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ad9f2-8c4d-4ada-af8e-408eb7ccd945 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:55.693707 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c244a4-2468-42a5-857a-2f72a285452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:55.695143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c244a4-2468-42a5-857a-2f72a285452c None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:55.695578 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c244a4-2468-42a5-857a-2f72a285452c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:55.695999 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c244a4-2468-42a5-857a-2f72a285452c None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:55.696872 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c244a4-2468-42a5-857a-2f72a285452c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:55.698572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c244a4-2468-42a5-857a-2f72a285452c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:55.730072 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 20/37] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:00:55 2022] POST /identity/v3/projects => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:00:55.731421 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c244a4-2468-42a5-857a-2f72a285452c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:55.789399 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 18/38] 10.222.0.13 () {58 vars in 1361 bytes} [Tue Jul 5 10:00:55 2022] PUT /identity/v3/domains/default/users/88fb21474f844e15aceece6e67aa28d0/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:00:55.904211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:55.952064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd149a9-137a-4296-a394-be3ffc6cc139 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:55.952361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd149a9-137a-4296-a394-be3ffc6cc139 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:55.952657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd149a9-137a-4296-a394-be3ffc6cc139 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:55.957391 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 19/39] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:00:55.962766 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a28f5b-cdb2-41f0-904d-5009ab7121a8 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:55.963060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a28f5b-cdb2-41f0-904d-5009ab7121a8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:55.963351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a28f5b-cdb2-41f0-904d-5009ab7121a8 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:55.965896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 20/40] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:00:55.966871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc694946-9050-4fd7-ba05-082927c14547 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:55.967225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc694946-9050-4fd7-ba05-082927c14547 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:55.967512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc694946-9050-4fd7-ba05-082927c14547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:55.991193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-dc694946-9050-4fd7-ba05-082927c14547 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:55.992787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-dc694946-9050-4fd7-ba05-082927c14547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:55.994585 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c244a4-2468-42a5-857a-2f72a285452c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:56.048692 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36ea44-5482-4536-8d60-96ead33e0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:56.050396 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36ea44-5482-4536-8d60-96ead33e0ffa None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:56.050877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36ea44-5482-4536-8d60-96ead33e0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:56.051590 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36ea44-5482-4536-8d60-96ead33e0ffa None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:56.053074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36ea44-5482-4536-8d60-96ead33e0ffa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:56.055153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36ea44-5482-4536-8d60-96ead33e0ffa None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:56.069667 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Jul 5 10:00:55 2022] POST /identity/v3/roles => generated 225 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:00:56.071384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9e1b-f710-46fd-a5a3-7ec9a18a7299 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:56.071883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9e1b-f710-46fd-a5a3-7ec9a18a7299 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:56.072361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9e1b-f710-46fd-a5a3-7ec9a18a7299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:56.084513 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 21/42] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:00:56.095888 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-061d9e1b-f710-46fd-a5a3-7ec9a18a7299 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:56.098035 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-061d9e1b-f710-46fd-a5a3-7ec9a18a7299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:56.108200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc694946-9050-4fd7-ba05-082927c14547 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:56.140830 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:56.179357 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 22/43] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:00:56.204756 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d9e1b-f710-46fd-a5a3-7ec9a18a7299 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:56.231889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc694946-9050-4fd7-ba05-082927c14547 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:56.235313 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:56.275790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6192d-a676-440d-868f-194eb4b674a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:56.276753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6192d-a676-440d-868f-194eb4b674a4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:56.277218 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6192d-a676-440d-868f-194eb4b674a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:56.277595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6192d-a676-440d-868f-194eb4b674a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:56.279424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6192d-a676-440d-868f-194eb4b674a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:56.281490 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6192d-a676-440d-868f-194eb4b674a4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:56.283512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 22/44] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:00:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:00:56.290520 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6192d-a676-440d-868f-194eb4b674a4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:56.342008 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d9e1b-f710-46fd-a5a3-7ec9a18a7299 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:56.379219 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0a512-16fb-4c20-88f6-760d369a4cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:56.379899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a512-16fb-4c20-88f6-760d369a4cf3 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:56.380181 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a512-16fb-4c20-88f6-760d369a4cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:56.380455 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a512-16fb-4c20-88f6-760d369a4cf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:56.381288 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0a512-16fb-4c20-88f6-760d369a4cf3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:56.382684 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0a512-16fb-4c20-88f6-760d369a4cf3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:56.396253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Jul 5 10:00:56 2022] POST /identity/v3/roles => generated 223 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:00:56.398621 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:56.418870 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6192d-a676-440d-868f-194eb4b674a4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:56.458043 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32536f86-21f8-4d66-a9ab-87e9be0f76a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:56.458772 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32536f86-21f8-4d66-a9ab-87e9be0f76a8 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:56.459061 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32536f86-21f8-4d66-a9ab-87e9be0f76a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:56.459340 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32536f86-21f8-4d66-a9ab-87e9be0f76a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:56.460067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32536f86-21f8-4d66-a9ab-87e9be0f76a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:56.461624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32536f86-21f8-4d66-a9ab-87e9be0f76a8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:56.494615 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:00:56 2022] POST /identity/v3/projects => generated 312 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:00:57.945978 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324ff54-c071-451c-be23-7857b46972c3 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:57.946484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324ff54-c071-451c-be23-7857b46972c3 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:57.946568 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324ff54-c071-451c-be23-7857b46972c3 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:57.947928 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 24/47] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:00:57.952974 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83825d0b-5f9f-4992-b306-80d4c862ba2e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:57.953375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83825d0b-5f9f-4992-b306-80d4c862ba2e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:57.953559 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83825d0b-5f9f-4992-b306-80d4c862ba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:57.969937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-83825d0b-5f9f-4992-b306-80d4c862ba2e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:57.971127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-83825d0b-5f9f-4992-b306-80d4c862ba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:58.039132 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 24/48] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:00:58.063110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324ff54-c071-451c-be23-7857b46972c3 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:58.151359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:58.169440 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324ff54-c071-451c-be23-7857b46972c3 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:58.203906 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdd921-ec78-4287-b6b6-94ef3388dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:58.204630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdd921-ec78-4287-b6b6-94ef3388dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:58.204935 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdd921-ec78-4287-b6b6-94ef3388dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:58.205220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdd921-ec78-4287-b6b6-94ef3388dbc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:58.215348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdd921-ec78-4287-b6b6-94ef3388dbc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-42bdd921-ec78-4287-b6b6-94ef3388dbc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:00:58.222984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:00:58.223974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:00:58.225077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 25/49] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:00:58.229901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83825d0b-5f9f-4992-b306-80d4c862ba2e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:58.294730 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:58.330551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83825d0b-5f9f-4992-b306-80d4c862ba2e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:58.362497 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f12cd-dc8b-4eae-86f7-72b8da40205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:58.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f12cd-dc8b-4eae-86f7-72b8da40205e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:58.363461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f12cd-dc8b-4eae-86f7-72b8da40205e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:58.363748 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f12cd-dc8b-4eae-86f7-72b8da40205e None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:58.364501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f12cd-dc8b-4eae-86f7-72b8da40205e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:00:58.364816 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f12cd-dc8b-4eae-86f7-72b8da40205e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:58.366777 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f12cd-dc8b-4eae-86f7-72b8da40205e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:58.374877 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 25/50] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:00:58.380458 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdd921-ec78-4287-b6b6-94ef3388dbc5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:58.477062 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdd921-ec78-4287-b6b6-94ef3388dbc5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:58.506569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393230f-29e9-4806-bf3e-1fc2499253ba None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:58.506865 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393230f-29e9-4806-bf3e-1fc2499253ba None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:58.507154 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393230f-29e9-4806-bf3e-1fc2499253ba None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:58.508541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 26/51] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:00:58.510743 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a032a5e-d31b-4018-a138-ff974491918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:58.511621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a032a5e-d31b-4018-a138-ff974491918a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:58.512081 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a032a5e-d31b-4018-a138-ff974491918a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:58.512180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a032a5e-d31b-4018-a138-ff974491918a None admin] PATH_INFO: `/v3/users/88fb21474f844e15aceece6e67aa28d0` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:58.513265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ef4b3-c37c-4921-af6b-f615d9ec8570 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:58.513371 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a032a5e-d31b-4018-a138-ff974491918a None admin] RBAC: Authorizing `identity:get_user(user_id=88fb21474f844e15aceece6e67aa28d0)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:58.513562 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ef4b3-c37c-4921-af6b-f615d9ec8570 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:58.513845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ef4b3-c37c-4921-af6b-f615d9ec8570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:58.514841 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a032a5e-d31b-4018-a138-ff974491918a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:58.516473 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 26/52] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:00:58 2022] GET /identity/v3/users/88fb21474f844e15aceece6e67aa28d0 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:00:58.522048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a032a5e-d31b-4018-a138-ff974491918a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:58.530580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9e0ef4b3-c37c-4921-af6b-f615d9ec8570 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:00:58.531775 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9e0ef4b3-c37c-4921-af6b-f615d9ec8570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:00:58.537738 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:58.598823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 27/53] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:00:58.619796 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a032a5e-d31b-4018-a138-ff974491918a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:58.621201 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ef4b3-c37c-4921-af6b-f615d9ec8570 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:58.653875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980e6e0-d9aa-4a49-96a2-7570f1418514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:58.654672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980e6e0-d9aa-4a49-96a2-7570f1418514 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:58.654957 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980e6e0-d9aa-4a49-96a2-7570f1418514 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:58.655236 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980e6e0-d9aa-4a49-96a2-7570f1418514 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:58.656400 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980e6e0-d9aa-4a49-96a2-7570f1418514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:58.657875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980e6e0-d9aa-4a49-96a2-7570f1418514 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:58.659488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 27/54] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:00:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:00:58.665362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980e6e0-d9aa-4a49-96a2-7570f1418514 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:58.749571 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:58.768365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980e6e0-d9aa-4a49-96a2-7570f1418514 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:58.782948 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:58.803189 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd42e75-decf-43d4-97a5-c7de6cd4a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:58.803838 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42e75-decf-43d4-97a5-c7de6cd4a539 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:58.804123 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42e75-decf-43d4-97a5-c7de6cd4a539 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:58.804398 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42e75-decf-43d4-97a5-c7de6cd4a539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:58.805263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd42e75-decf-43d4-97a5-c7de6cd4a539 None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.domain.id=default, user.id=88fb21474f844e15aceece6e67aa28d0) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:00:58.805577 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd42e75-decf-43d4-97a5-c7de6cd4a539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:58.807033 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd42e75-decf-43d4-97a5-c7de6cd4a539 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:58.813041 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1322 bytes} [Tue Jul 5 10:00:58 2022] GET /identity/v3/role_assignments?user.id=88fb21474f844e15aceece6e67aa28d0&scope.domain.id=default&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:00:58.828408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ef4b3-c37c-4921-af6b-f615d9ec8570 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:58.865566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f91b89-7576-4ca3-be8f-418dad280d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:58.866404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f91b89-7576-4ca3-be8f-418dad280d61 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:58.866695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f91b89-7576-4ca3-be8f-418dad280d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:58.866978 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f91b89-7576-4ca3-be8f-418dad280d61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:58.868254 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f91b89-7576-4ca3-be8f-418dad280d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:58.869795 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f91b89-7576-4ca3-be8f-418dad280d61 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:58.871562 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 28/56] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:00:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:00:58.883350 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd42e75-decf-43d4-97a5-c7de6cd4a539 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:00:58.988489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd42e75-decf-43d4-97a5-c7de6cd4a539 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:00:59.022538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94566c-13e6-4e71-b05a-473abf134731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:00:59.023132 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94566c-13e6-4e71-b05a-473abf134731 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:00:59.023425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94566c-13e6-4e71-b05a-473abf134731 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:00:59.023702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94566c-13e6-4e71-b05a-473abf134731 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:00:59.024410 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94566c-13e6-4e71-b05a-473abf134731 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:00:59.025946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94566c-13e6-4e71-b05a-473abf134731 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:00:59.044805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:00:59.051663 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 29/57] 10.222.0.13 () {60 vars in 1140 bytes} [Tue Jul 5 10:00:58 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:01.066282 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb03cbc-97fb-47e0-942b-c2e02a65ca09 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:01.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb03cbc-97fb-47e0-942b-c2e02a65ca09 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:01.066901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb03cbc-97fb-47e0-942b-c2e02a65ca09 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:01.068242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 29/58] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:01.073290 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376796-e7c5-4261-8be9-e51983f31d1d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:01.073644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376796-e7c5-4261-8be9-e51983f31d1d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:01.073861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376796-e7c5-4261-8be9-e51983f31d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:01.090092 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-16376796-e7c5-4261-8be9-e51983f31d1d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:01.091285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-16376796-e7c5-4261-8be9-e51983f31d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:01.155988 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:01.181988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb03cbc-97fb-47e0-942b-c2e02a65ca09 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:01.277963 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb03cbc-97fb-47e0-942b-c2e02a65ca09 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:01.303109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:01.311804 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee104c7-ac1d-4406-9d39-64a5d7f4248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:01.312606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee104c7-ac1d-4406-9d39-64a5d7f4248b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:01.312927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee104c7-ac1d-4406-9d39-64a5d7f4248b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:01.313208 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee104c7-ac1d-4406-9d39-64a5d7f4248b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:01.314382 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee104c7-ac1d-4406-9d39-64a5d7f4248b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:01.315823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee104c7-ac1d-4406-9d39-64a5d7f4248b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:01.317538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 30/60] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:01.322831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376796-e7c5-4261-8be9-e51983f31d1d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:01.418292 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376796-e7c5-4261-8be9-e51983f31d1d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:01.443508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:01.451413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a56d0-011a-43f1-ac7a-00dc6e2f7182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:01.452094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a56d0-011a-43f1-ac7a-00dc6e2f7182 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:01.452389 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a56d0-011a-43f1-ac7a-00dc6e2f7182 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:01.452675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a56d0-011a-43f1-ac7a-00dc6e2f7182 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:01.453430 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a56d0-011a-43f1-ac7a-00dc6e2f7182 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:01.454895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a56d0-011a-43f1-ac7a-00dc6e2f7182 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:01.479701 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 31/61] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:01:01 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:04.585620 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898964-cf8d-49bc-9430-994f5ad0efa0 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:04.586606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898964-cf8d-49bc-9430-994f5ad0efa0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:04.587093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898964-cf8d-49bc-9430-994f5ad0efa0 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:04.588668 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 31/62] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:04.594146 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2252d-fb6a-42b7-b2d6-cbbbf55282e2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:04.594992 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2252d-fb6a-42b7-b2d6-cbbbf55282e2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:04.595478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2252d-fb6a-42b7-b2d6-cbbbf55282e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:04.622188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-eaa2252d-fb6a-42b7-b2d6-cbbbf55282e2 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:04.623722 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-eaa2252d-fb6a-42b7-b2d6-cbbbf55282e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:04.707793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1576625-c4f5-4456-a49e-10a2edd20bee None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:04.708446 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1576625-c4f5-4456-a49e-10a2edd20bee None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:04.708978 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1576625-c4f5-4456-a49e-10a2edd20bee None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:04.710811 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:04.715606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47987b-7d69-4e54-8c46-c52df0e4121d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:04.716168 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47987b-7d69-4e54-8c46-c52df0e4121d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:04.716670 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47987b-7d69-4e54-8c46-c52df0e4121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:04.732766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 32/64] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:04.745271 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ab47987b-7d69-4e54-8c46-c52df0e4121d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:04.746628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ab47987b-7d69-4e54-8c46-c52df0e4121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:04.771045 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2252d-fb6a-42b7-b2d6-cbbbf55282e2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:04.858351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 33/65] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:04.859914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d053-2508-4b55-9348-b12254a822f8 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:04.860356 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d053-2508-4b55-9348-b12254a822f8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:04.860783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d053-2508-4b55-9348-b12254a822f8 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:04.862340 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 34/66] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:04.872922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a652ac5-bfef-40f6-b51e-9758f79bd22c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:04.873402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a652ac5-bfef-40f6-b51e-9758f79bd22c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:04.873903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a652ac5-bfef-40f6-b51e-9758f79bd22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:04.894952 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2a652ac5-bfef-40f6-b51e-9758f79bd22c None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:04.896394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2a652ac5-bfef-40f6-b51e-9758f79bd22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:04.897256 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2252d-fb6a-42b7-b2d6-cbbbf55282e2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:04.912672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:04.939274 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd9246-c45c-4f64-a2b1-9f36bae257a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:04.940315 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd9246-c45c-4f64-a2b1-9f36bae257a1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:04.940744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd9246-c45c-4f64-a2b1-9f36bae257a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:04.941205 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd9246-c45c-4f64-a2b1-9f36bae257a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:04.951997 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd9246-c45c-4f64-a2b1-9f36bae257a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-49cd9246-c45c-4f64-a2b1-9f36bae257a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:04.960767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:04.961911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:04.962845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:04.965033 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 33/67] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:04.965993 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd9246-c45c-4f64-a2b1-9f36bae257a1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:04.983048 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 35/68] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:04.993586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a652ac5-bfef-40f6-b51e-9758f79bd22c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:05.067391 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:05.074144 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd9246-c45c-4f64-a2b1-9f36bae257a1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:05.114152 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e1027-2b59-4c83-b593-7303af658090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:05.115210 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1027-2b59-4c83-b593-7303af658090 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.115320 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a652ac5-bfef-40f6-b51e-9758f79bd22c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:05.115730 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1027-2b59-4c83-b593-7303af658090 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.116169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1027-2b59-4c83-b593-7303af658090 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.127558 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e1027-2b59-4c83-b593-7303af658090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-ca5e1027-2b59-4c83-b593-7303af658090 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:05.135946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:05.136987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:05.137882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:05.139964 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:05.140912 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e1027-2b59-4c83-b593-7303af658090 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:05.151441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4493590-5974-4df6-9a56-7c38fd287dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:05.152083 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4493590-5974-4df6-9a56-7c38fd287dcc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.152381 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4493590-5974-4df6-9a56-7c38fd287dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.152666 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4493590-5974-4df6-9a56-7c38fd287dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.153460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4493590-5974-4df6-9a56-7c38fd287dcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:05.153778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4493590-5974-4df6-9a56-7c38fd287dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:05.155294 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4493590-5974-4df6-9a56-7c38fd287dcc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:05.165015 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:05.165852 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4493590-5974-4df6-9a56-7c38fd287dcc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:05.181031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:05.252130 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e1027-2b59-4c83-b593-7303af658090 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:05.276127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4493590-5974-4df6-9a56-7c38fd287dcc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:05.289786 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef8cad-78d7-4904-adb6-7355eef5fc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:05.290691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8cad-78d7-4904-adb6-7355eef5fc94 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.290980 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8cad-78d7-4904-adb6-7355eef5fc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.291265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8cad-78d7-4904-adb6-7355eef5fc94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.292219 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:05.303047 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef8cad-78d7-4904-adb6-7355eef5fc94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-dcef8cad-78d7-4904-adb6-7355eef5fc94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:05.311159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:05.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:05.312831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:05.313496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef8cad-78d7-4904-adb6-7355eef5fc94 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:05.314251 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7987fca-c39b-44bb-9a48-868a8cd6155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:05.314935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7987fca-c39b-44bb-9a48-868a8cd6155c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7987fca-c39b-44bb-9a48-868a8cd6155c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.315552 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7987fca-c39b-44bb-9a48-868a8cd6155c None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7987fca-c39b-44bb-9a48-868a8cd6155c None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:05.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7987fca-c39b-44bb-9a48-868a8cd6155c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:05.318675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7987fca-c39b-44bb-9a48-868a8cd6155c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:05.326981 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 37/72] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:05.328265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3a7c9-4814-4a6c-8941-0fa12b87bcf1 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.328558 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3a7c9-4814-4a6c-8941-0fa12b87bcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.329036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3a7c9-4814-4a6c-8941-0fa12b87bcf1 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.330244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 38/73] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:05.335220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d39f95-b8fd-4cd4-a54a-6e2ec60f10d5 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.335506 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d39f95-b8fd-4cd4-a54a-6e2ec60f10d5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.335791 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d39f95-b8fd-4cd4-a54a-6e2ec60f10d5 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.337066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 39/74] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:05.337758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d39f95-b8fd-4cd4-a54a-6e2ec60f10d5 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:05.404010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:05.411252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef8cad-78d7-4904-adb6-7355eef5fc94 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:05.440396 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d39f95-b8fd-4cd4-a54a-6e2ec60f10d5 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:05.444550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e01852-119b-4454-a494-df9a59ef3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:05.445467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e01852-119b-4454-a494-df9a59ef3b25 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.445760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e01852-119b-4454-a494-df9a59ef3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.446043 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e01852-119b-4454-a494-df9a59ef3b25 None admin] PATH_INFO: `/v3/users/88fb21474f844e15aceece6e67aa28d0` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.447253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e01852-119b-4454-a494-df9a59ef3b25 None admin] RBAC: Authorizing `identity:get_user(user_id=88fb21474f844e15aceece6e67aa28d0)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:05.448733 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e01852-119b-4454-a494-df9a59ef3b25 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:05.450408 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 36/75] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:05 2022] GET /identity/v3/users/88fb21474f844e15aceece6e67aa28d0 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:05.451174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e01852-119b-4454-a494-df9a59ef3b25 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:05.473210 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc22ff-0ec6-44c7-87f6-effe0ae4540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:05.473887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc22ff-0ec6-44c7-87f6-effe0ae4540f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.474699 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc22ff-0ec6-44c7-87f6-effe0ae4540f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.474983 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc22ff-0ec6-44c7-87f6-effe0ae4540f None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.475724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc22ff-0ec6-44c7-87f6-effe0ae4540f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:05.476035 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc22ff-0ec6-44c7-87f6-effe0ae4540f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:05.477430 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc22ff-0ec6-44c7-87f6-effe0ae4540f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:05.485146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 40/76] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:05.487385 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc394e-fb60-462f-9469-559cabd08bad None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.487703 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc394e-fb60-462f-9469-559cabd08bad None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.487977 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc394e-fb60-462f-9469-559cabd08bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.504389 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-43fc394e-fb60-462f-9469-559cabd08bad None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:05.506077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-43fc394e-fb60-462f-9469-559cabd08bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:05.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:05.553860 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e01852-119b-4454-a494-df9a59ef3b25 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:05.572364 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 41/77] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:05.574239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26348b-87aa-4c5b-8dfa-592b5726a96f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.574542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26348b-87aa-4c5b-8dfa-592b5726a96f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.574831 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26348b-87aa-4c5b-8dfa-592b5726a96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.590813 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6b26348b-87aa-4c5b-8dfa-592b5726a96f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:05.591989 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6b26348b-87aa-4c5b-8dfa-592b5726a96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:05.602957 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1cc98-4299-4e4d-ade6-c4e1c5113861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:05.603845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1cc98-4299-4e4d-ade6-c4e1c5113861 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.604132 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1cc98-4299-4e4d-ade6-c4e1c5113861 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.604413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1cc98-4299-4e4d-ade6-c4e1c5113861 None admin] PATH_INFO: `/v3/users/fdbc028fc50242ca95b20286bf2d6e57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.617484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1cc98-4299-4e4d-ade6-c4e1c5113861 None admin] RBAC: Authorizing `identity:get_user(user_id=fdbc028fc50242ca95b20286bf2d6e57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:05.618953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1cc98-4299-4e4d-ade6-c4e1c5113861 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:05.620786 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 37/78] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:05 2022] GET /identity/v3/users/fdbc028fc50242ca95b20286bf2d6e57 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:05.621404 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1cc98-4299-4e4d-ade6-c4e1c5113861 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:05.643596 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:05.661696 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 42/79] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:05.662475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26348b-87aa-4c5b-8dfa-592b5726a96f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:05.720999 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1cc98-4299-4e4d-ade6-c4e1c5113861 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:05.753193 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c55b8-1e9e-420b-895d-a55f3f665c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:05.753844 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c55b8-1e9e-420b-895d-a55f3f665c2d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.754134 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c55b8-1e9e-420b-895d-a55f3f665c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.754476 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c55b8-1e9e-420b-895d-a55f3f665c2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.764667 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:05.768135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26348b-87aa-4c5b-8dfa-592b5726a96f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:05.801086 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a59947-dbf5-4f0b-99ca-fe1cc75a4896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:05.801972 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a59947-dbf5-4f0b-99ca-fe1cc75a4896 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.802750 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a59947-dbf5-4f0b-99ca-fe1cc75a4896 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.803038 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a59947-dbf5-4f0b-99ca-fe1cc75a4896 None admin] PATH_INFO: `/v3/users/fdbc028fc50242ca95b20286bf2d6e57` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.804256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a59947-dbf5-4f0b-99ca-fe1cc75a4896 None admin] RBAC: Authorizing `identity:get_user(user_id=fdbc028fc50242ca95b20286bf2d6e57)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:05.805740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a59947-dbf5-4f0b-99ca-fe1cc75a4896 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:05.807551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 43/80] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:05 2022] GET /identity/v3/users/fdbc028fc50242ca95b20286bf2d6e57 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:05.808155 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a59947-dbf5-4f0b-99ca-fe1cc75a4896 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:05.825029 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c55b8-1e9e-420b-895d-a55f3f665c2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:05.826514 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c55b8-1e9e-420b-895d-a55f3f665c2d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:05.846130 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:05.905091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a59947-dbf5-4f0b-99ca-fe1cc75a4896 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:05.922639 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 38/81] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:05.923405 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c55b8-1e9e-420b-895d-a55f3f665c2d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:05.942113 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aca87-a299-44f6-90fc-4413a9c28ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:05.943428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aca87-a299-44f6-90fc-4413a9c28ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:05.943723 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aca87-a299-44f6-90fc-4413a9c28ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:05.944000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aca87-a299-44f6-90fc-4413a9c28ba5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:05.955161 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aca87-a299-44f6-90fc-4413a9c28ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ee2aca87-a299-44f6-90fc-4413a9c28ba5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:05.964601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:05.965461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:05.966214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 44/82] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:05.966833 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aca87-a299-44f6-90fc-4413a9c28ba5 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:05.999238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:06.024604 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c55b8-1e9e-420b-895d-a55f3f665c2d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:06.045449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:06.059794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319dd88-944b-452b-861e-cde90aa3762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:06.060450 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319dd88-944b-452b-861e-cde90aa3762c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:06.060736 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319dd88-944b-452b-861e-cde90aa3762c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:06.061046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319dd88-944b-452b-861e-cde90aa3762c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:06.072445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aca87-a299-44f6-90fc-4413a9c28ba5 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:06.104841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9b30e-7903-464f-b42d-d53d0f9d7ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:06.105658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9b30e-7903-464f-b42d-d53d0f9d7ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:06.105944 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9b30e-7903-464f-b42d-d53d0f9d7ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:06.106226 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9b30e-7903-464f-b42d-d53d0f9d7ba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:06.107407 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9b30e-7903-464f-b42d-d53d0f9d7ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:06.108856 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9b30e-7903-464f-b42d-d53d0f9d7ba2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:06.110491 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 45/83] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:06.113704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9b30e-7903-464f-b42d-d53d0f9d7ba2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:06.127631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319dd88-944b-452b-861e-cde90aa3762c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:06.129154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319dd88-944b-452b-861e-cde90aa3762c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:06.205400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:06.211780 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9b30e-7903-464f-b42d-d53d0f9d7ba2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:06.224992 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 39/84] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:06.224992 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319dd88-944b-452b-861e-cde90aa3762c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:06.245916 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:06.249717 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce529224-e241-4446-8057-90a2ffe2ed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:06.250446 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529224-e241-4446-8057-90a2ffe2ed94 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:06.250801 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529224-e241-4446-8057-90a2ffe2ed94 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:06.251086 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529224-e241-4446-8057-90a2ffe2ed94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:06.317616 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce529224-e241-4446-8057-90a2ffe2ed94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:06.319117 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce529224-e241-4446-8057-90a2ffe2ed94 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:06.325561 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319dd88-944b-452b-861e-cde90aa3762c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:06.360359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfafaa-f179-42d3-9365-aa993f1f1018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:06.361260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfafaa-f179-42d3-9365-aa993f1f1018 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:06.361552 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfafaa-f179-42d3-9365-aa993f1f1018 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:06.362130 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfafaa-f179-42d3-9365-aa993f1f1018 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:06.363041 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfafaa-f179-42d3-9365-aa993f1f1018 None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:06.364487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfafaa-f179-42d3-9365-aa993f1f1018 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:06.366957 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 40/85] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:06 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:06.367528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfafaa-f179-42d3-9365-aa993f1f1018 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:06.412062 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:06.419894 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 46/86] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:06.420811 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce529224-e241-4446-8057-90a2ffe2ed94 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:06.451921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:06.464864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfafaa-f179-42d3-9365-aa993f1f1018 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:06.499294 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdbc5d-92dd-4686-8763-1575e20d15a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:06.499960 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdbc5d-92dd-4686-8763-1575e20d15a7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:06.500253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdbc5d-92dd-4686-8763-1575e20d15a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:06.500537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdbc5d-92dd-4686-8763-1575e20d15a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:06.501314 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdbc5d-92dd-4686-8763-1575e20d15a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:06.501627 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdbc5d-92dd-4686-8763-1575e20d15a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:06.503187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdbc5d-92dd-4686-8763-1575e20d15a7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:06.512299 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 41/87] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:06.513125 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdbc5d-92dd-4686-8763-1575e20d15a7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:06.522368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce529224-e241-4446-8057-90a2ffe2ed94 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:06.555996 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b18dd4-4361-4bbb-b0b8-25548bbcaa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:06.556668 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18dd4-4361-4bbb-b0b8-25548bbcaa8c None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:06.556993 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18dd4-4361-4bbb-b0b8-25548bbcaa8c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:06.557281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18dd4-4361-4bbb-b0b8-25548bbcaa8c None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:06.558001 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b18dd4-4361-4bbb-b0b8-25548bbcaa8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:06.559456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b18dd4-4361-4bbb-b0b8-25548bbcaa8c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:06.584942 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 47/88] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:01:06 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:06.585761 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b18dd4-4361-4bbb-b0b8-25548bbcaa8c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:06.633345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdbc5d-92dd-4686-8763-1575e20d15a7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:06.645541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:06.675344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a231f-5429-4d65-adea-26025d598180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:06.676364 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a231f-5429-4d65-adea-26025d598180 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:06.676725 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a231f-5429-4d65-adea-26025d598180 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:06.677666 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a231f-5429-4d65-adea-26025d598180 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:06.678954 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a231f-5429-4d65-adea-26025d598180 None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:06.680468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a231f-5429-4d65-adea-26025d598180 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:06.682300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 42/89] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:06 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:06.683096 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a231f-5429-4d65-adea-26025d598180 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:06.705618 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:06.709629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b18dd4-4361-4bbb-b0b8-25548bbcaa8c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:06.752785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949e23d-d28c-4439-9a3f-bffb696d6505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:06.753529 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949e23d-d28c-4439-9a3f-bffb696d6505 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:06.753816 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949e23d-d28c-4439-9a3f-bffb696d6505 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:06.754342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949e23d-d28c-4439-9a3f-bffb696d6505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:06.754933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949e23d-d28c-4439-9a3f-bffb696d6505 None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=6055d4c138374609abba19bcdd29bb97, user.id=88fb21474f844e15aceece6e67aa28d0) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:06.755248 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949e23d-d28c-4439-9a3f-bffb696d6505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:06.757334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949e23d-d28c-4439-9a3f-bffb696d6505 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:06.766573 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 48/90] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:06 2022] GET /identity/v3/role_assignments?user.id=88fb21474f844e15aceece6e67aa28d0&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:06.767398 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949e23d-d28c-4439-9a3f-bffb696d6505 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:06.821188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a231f-5429-4d65-adea-26025d598180 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:06.876376 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f2bd-1c17-45f4-b52c-825173d9f414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:06.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f2bd-1c17-45f4-b52c-825173d9f414 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:06.877602 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f2bd-1c17-45f4-b52c-825173d9f414 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:06.877889 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f2bd-1c17-45f4-b52c-825173d9f414 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:06.880960 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f2bd-1c17-45f4-b52c-825173d9f414 None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:06.882666 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f2bd-1c17-45f4-b52c-825173d9f414 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:06.885420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 43/91] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:06 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:06.886316 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f2bd-1c17-45f4-b52c-825173d9f414 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:06.913192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949e23d-d28c-4439-9a3f-bffb696d6505 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:06.938004 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:06.968274 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22774bd2-66a2-4786-aeba-78dc664e4581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:06.969304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22774bd2-66a2-4786-aeba-78dc664e4581 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:06.969597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22774bd2-66a2-4786-aeba-78dc664e4581 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:06.969873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22774bd2-66a2-4786-aeba-78dc664e4581 None admin] PATH_INFO: `/v3/users/fdbc028fc50242ca95b20286bf2d6e57` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:06.971233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22774bd2-66a2-4786-aeba-78dc664e4581 None admin] RBAC: Authorizing `identity:get_user(user_id=fdbc028fc50242ca95b20286bf2d6e57)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:06.972762 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22774bd2-66a2-4786-aeba-78dc664e4581 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:06.974793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 49/92] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:06 2022] GET /identity/v3/users/fdbc028fc50242ca95b20286bf2d6e57 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:06.975573 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22774bd2-66a2-4786-aeba-78dc664e4581 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:07.007919 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:07.025949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f2bd-1c17-45f4-b52c-825173d9f414 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:07.100435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22774bd2-66a2-4786-aeba-78dc664e4581 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:07.125624 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b13485-7f64-486c-b3ce-4146db941b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:07.126711 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b13485-7f64-486c-b3ce-4146db941b41 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:07.127204 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b13485-7f64-486c-b3ce-4146db941b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:07.127708 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b13485-7f64-486c-b3ce-4146db941b41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:07.128794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b13485-7f64-486c-b3ce-4146db941b41 None admin] RBAC: Adding query filter params (role.id=14df33950256418dae713180ece879af, scope.project.id=6055d4c138374609abba19bcdd29bb97, user.id=fdbc028fc50242ca95b20286bf2d6e57) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:07.129338 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b13485-7f64-486c-b3ce-4146db941b41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:07.131055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b13485-7f64-486c-b3ce-4146db941b41 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:07.136916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a87368-8568-4db3-b473-f8da36392387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:07.136916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a87368-8568-4db3-b473-f8da36392387 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:07.136916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a87368-8568-4db3-b473-f8da36392387 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:07.136916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a87368-8568-4db3-b473-f8da36392387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:07.137684 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a87368-8568-4db3-b473-f8da36392387 None admin] RBAC: Adding query filter params (role.id=a11101f17a5c44e5b5454f2f8af57cf3, scope.project.id=6055d4c138374609abba19bcdd29bb97, user.id=fdbc028fc50242ca95b20286bf2d6e57) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:07.138003 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a87368-8568-4db3-b473-f8da36392387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:07.139605 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a87368-8568-4db3-b473-f8da36392387 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:07.145327 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 50/93] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:06 2022] GET /identity/v3/role_assignments?user.id=fdbc028fc50242ca95b20286bf2d6e57&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=a11101f17a5c44e5b5454f2f8af57cf3 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:07.146245 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a87368-8568-4db3-b473-f8da36392387 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:07.147515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 44/94] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:06 2022] GET /identity/v3/role_assignments?user.id=fdbc028fc50242ca95b20286bf2d6e57&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=14df33950256418dae713180ece879af => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:07.216470 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:07.293373 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a87368-8568-4db3-b473-f8da36392387 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:07.329973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389e573-2c01-4267-bc62-0b6e6b89d733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:07.330668 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389e573-2c01-4267-bc62-0b6e6b89d733 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:07.330962 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389e573-2c01-4267-bc62-0b6e6b89d733 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:07.331247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389e573-2c01-4267-bc62-0b6e6b89d733 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:07.408992 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389e573-2c01-4267-bc62-0b6e6b89d733 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:07.410506 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389e573-2c01-4267-bc62-0b6e6b89d733 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:07.466200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:07.521626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 51/95] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:07.527046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b13485-7f64-486c-b3ce-4146db941b41 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:07.646901 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b13485-7f64-486c-b3ce-4146db941b41 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:07.685486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e53ee-3158-4f29-b92f-4c5902fa9f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:07.686368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e53ee-3158-4f29-b92f-4c5902fa9f1d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:07.686660 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e53ee-3158-4f29-b92f-4c5902fa9f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:07.686944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e53ee-3158-4f29-b92f-4c5902fa9f1d None admin] PATH_INFO: `/v3/projects/08afa27218fa471096ddd2a4a024b139` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:07.688176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e53ee-3158-4f29-b92f-4c5902fa9f1d None admin] RBAC: Authorizing `identity:get_project(project_id=08afa27218fa471096ddd2a4a024b139)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:07.689678 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e53ee-3158-4f29-b92f-4c5902fa9f1d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:07.691469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 45/96] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:07 2022] GET /identity/v3/projects/08afa27218fa471096ddd2a4a024b139 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:07.698073 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389e573-2c01-4267-bc62-0b6e6b89d733 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:07.800000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389e573-2c01-4267-bc62-0b6e6b89d733 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:07.835611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7d8d1-d28b-4f51-a3b2-88fb52122907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:07.836280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7d8d1-d28b-4f51-a3b2-88fb52122907 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:07.836569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7d8d1-d28b-4f51-a3b2-88fb52122907 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:07.836855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7d8d1-d28b-4f51-a3b2-88fb52122907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:07.837722 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7d8d1-d28b-4f51-a3b2-88fb52122907 None admin] RBAC: Adding query filter params (role.id=14df33950256418dae713180ece879af, scope.project.id=08afa27218fa471096ddd2a4a024b139, user.id=fdbc028fc50242ca95b20286bf2d6e57) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:07.838041 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7d8d1-d28b-4f51-a3b2-88fb52122907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:07.839503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7d8d1-d28b-4f51-a3b2-88fb52122907 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:07.845360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 52/97] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:07 2022] GET /identity/v3/role_assignments?user.id=fdbc028fc50242ca95b20286bf2d6e57&scope.project.id=08afa27218fa471096ddd2a4a024b139&role.id=14df33950256418dae713180ece879af => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:09.464437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6418-47e9-4d56-bd21-c6bb624535fd None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:09.465485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6418-47e9-4d56-bd21-c6bb624535fd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:09.465988 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6418-47e9-4d56-bd21-c6bb624535fd None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:09.467548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 46/98] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:09.472859 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cbcc2-39c2-4389-929c-5540e040cd75 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:09.473666 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cbcc2-39c2-4389-929c-5540e040cd75 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:09.474721 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cbcc2-39c2-4389-929c-5540e040cd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:09.497574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e21cbcc2-39c2-4389-929c-5540e040cd75 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:09.499084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e21cbcc2-39c2-4389-929c-5540e040cd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:09.507492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:09.534245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5720-afce-4da6-a472-edbdf0c58a6b None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:09.534907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5720-afce-4da6-a472-edbdf0c58a6b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:09.535401 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5720-afce-4da6-a472-edbdf0c58a6b None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:09.537698 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 47/99] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:09.553300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb3f7-36a3-4882-9896-8bb22eed796f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:09.553875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb3f7-36a3-4882-9896-8bb22eed796f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:09.554360 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb3f7-36a3-4882-9896-8bb22eed796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:09.577316 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c0fdb3f7-36a3-4882-9896-8bb22eed796f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:09.579510 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c0fdb3f7-36a3-4882-9896-8bb22eed796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:09.604985 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:09.618609 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 53/100] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:09.648026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cbcc2-39c2-4389-929c-5540e040cd75 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:09.728667 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 48/101] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:09.743301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530dcd9-ba6c-4fea-845a-66fabcdb1944 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:09.743787 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530dcd9-ba6c-4fea-845a-66fabcdb1944 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:09.744216 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530dcd9-ba6c-4fea-845a-66fabcdb1944 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:09.745749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 49/102] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:09.750845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292434b-1493-491a-a7ef-974e63e52a3f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:09.751313 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292434b-1493-491a-a7ef-974e63e52a3f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:09.751744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292434b-1493-491a-a7ef-974e63e52a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:09.780525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d292434b-1493-491a-a7ef-974e63e52a3f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:09.781750 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d292434b-1493-491a-a7ef-974e63e52a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:09.834891 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cbcc2-39c2-4389-929c-5540e040cd75 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:09.901730 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 50/103] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:09.902583 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eac47d-4806-40b7-883a-892eff78e6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:09.903471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eac47d-4806-40b7-883a-892eff78e6cf None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:09.903763 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eac47d-4806-40b7-883a-892eff78e6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:09.904046 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eac47d-4806-40b7-883a-892eff78e6cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:09.905275 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292434b-1493-491a-a7ef-974e63e52a3f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:09.928074 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eac47d-4806-40b7-883a-892eff78e6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-91eac47d-4806-40b7-883a-892eff78e6cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:09.945625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:09.946584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:09.947336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 54/104] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:09.949732 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eac47d-4806-40b7-883a-892eff78e6cf None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:09.954646 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:10.017788 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:10.060919 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292434b-1493-491a-a7ef-974e63e52a3f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:10.076446 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eac47d-4806-40b7-883a-892eff78e6cf None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:10.112789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a945a-e466-4845-80f0-22afd9b9f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:10.116915 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a945a-e466-4845-80f0-22afd9b9f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.116915 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a945a-e466-4845-80f0-22afd9b9f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.116915 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a945a-e466-4845-80f0-22afd9b9f9a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.126784 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a945a-e466-4845-80f0-22afd9b9f9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-858a945a-e466-4845-80f0-22afd9b9f9a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:10.135805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:10.136660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:10.137658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 55/105] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:01:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:10.138492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a945a-e466-4845-80f0-22afd9b9f9a7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:10.142527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b102f9-699b-40ee-9d6e-1ac37c18f092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:10.143582 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b102f9-699b-40ee-9d6e-1ac37c18f092 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.144083 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b102f9-699b-40ee-9d6e-1ac37c18f092 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.144579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b102f9-699b-40ee-9d6e-1ac37c18f092 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.146627 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b102f9-699b-40ee-9d6e-1ac37c18f092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:10.148317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b102f9-699b-40ee-9d6e-1ac37c18f092 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:10.154313 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 51/106] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:10.156138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b102f9-699b-40ee-9d6e-1ac37c18f092 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:10.212827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:10.249630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a945a-e466-4845-80f0-22afd9b9f9a7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:10.298309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465ed6-fa27-48cd-9178-3d5c58f21a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:10.299183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465ed6-fa27-48cd-9178-3d5c58f21a81 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.300837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465ed6-fa27-48cd-9178-3d5c58f21a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.301307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465ed6-fa27-48cd-9178-3d5c58f21a81 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.302954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465ed6-fa27-48cd-9178-3d5c58f21a81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:10.303597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465ed6-fa27-48cd-9178-3d5c58f21a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:10.306652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465ed6-fa27-48cd-9178-3d5c58f21a81 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:10.322635 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 56/107] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:10.325855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465ed6-fa27-48cd-9178-3d5c58f21a81 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:10.403650 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b102f9-699b-40ee-9d6e-1ac37c18f092 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:10.468364 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57beef-c619-4cdd-b9b3-801af4219491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:10.469091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57beef-c619-4cdd-b9b3-801af4219491 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.469373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57beef-c619-4cdd-b9b3-801af4219491 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.469655 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57beef-c619-4cdd-b9b3-801af4219491 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.470418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57beef-c619-4cdd-b9b3-801af4219491 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:10.470733 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57beef-c619-4cdd-b9b3-801af4219491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:10.472149 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57beef-c619-4cdd-b9b3-801af4219491 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:10.481549 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 52/108] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:10.482626 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57beef-c619-4cdd-b9b3-801af4219491 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:10.494603 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:10.499605 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465ed6-fa27-48cd-9178-3d5c58f21a81 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:10.529984 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:10.544980 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b230c-764b-408a-90ed-fb2458dd3981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:10.546235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b230c-764b-408a-90ed-fb2458dd3981 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.546971 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b230c-764b-408a-90ed-fb2458dd3981 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.547479 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b230c-764b-408a-90ed-fb2458dd3981 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.549102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b230c-764b-408a-90ed-fb2458dd3981 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:10.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b230c-764b-408a-90ed-fb2458dd3981 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:10.593735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 57/109] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:01:10 2022] POST /identity/v3/projects => generated 302 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:10.596459 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d9a16-6995-468d-a7a1-26930897d8ca None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.597010 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d9a16-6995-468d-a7a1-26930897d8ca None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.597527 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d9a16-6995-468d-a7a1-26930897d8ca None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.597730 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57beef-c619-4cdd-b9b3-801af4219491 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:10.599901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 58/110] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:10.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d9a16-6995-468d-a7a1-26930897d8ca None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:10.651745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e72d31-4057-400b-884a-dda91feb8f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:10.652710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72d31-4057-400b-884a-dda91feb8f99 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.653040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72d31-4057-400b-884a-dda91feb8f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.653328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72d31-4057-400b-884a-dda91feb8f99 None admin] PATH_INFO: `/v3/users/2e6dbcd5bea34072844b4fcf82ef2577` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.671086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e72d31-4057-400b-884a-dda91feb8f99 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6dbcd5bea34072844b4fcf82ef2577)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:10.672816 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e72d31-4057-400b-884a-dda91feb8f99 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:10.674731 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 53/111] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:10 2022] GET /identity/v3/users/2e6dbcd5bea34072844b4fcf82ef2577 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:10.676666 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0def1c-5d65-4d1e-9806-527557dc2350 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.676666 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0def1c-5d65-4d1e-9806-527557dc2350 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.676855 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0def1c-5d65-4d1e-9806-527557dc2350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.696457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5f0def1c-5d65-4d1e-9806-527557dc2350 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:10.697776 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5f0def1c-5d65-4d1e-9806-527557dc2350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:10.743987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d9a16-6995-468d-a7a1-26930897d8ca None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:10.767706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:10.778201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 54/112] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:10.779121 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654f81a-e1d3-4a5f-8278-c4cfb95ac5bb None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.779538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654f81a-e1d3-4a5f-8278-c4cfb95ac5bb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.779829 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654f81a-e1d3-4a5f-8278-c4cfb95ac5bb None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.781159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 55/113] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:10.785449 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5cb24-1a73-486d-b588-c50a6686ca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:10.785843 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654f81a-e1d3-4a5f-8278-c4cfb95ac5bb None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:10.786960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5cb24-1a73-486d-b588-c50a6686ca41 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.787405 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5cb24-1a73-486d-b588-c50a6686ca41 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.787692 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5cb24-1a73-486d-b588-c50a6686ca41 None admin] PATH_INFO: `/v3/users/88fb21474f844e15aceece6e67aa28d0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.789809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5cb24-1a73-486d-b588-c50a6686ca41 None admin] RBAC: Authorizing `identity:get_user(user_id=88fb21474f844e15aceece6e67aa28d0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:10.790421 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5cb24-1a73-486d-b588-c50a6686ca41 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:10.792230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 59/114] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:10 2022] GET /identity/v3/users/88fb21474f844e15aceece6e67aa28d0 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:10.793410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d927a1-519b-46aa-93c3-4ce4fe79cc7e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.793929 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d927a1-519b-46aa-93c3-4ce4fe79cc7e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.794335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d927a1-519b-46aa-93c3-4ce4fe79cc7e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.795443 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 60/115] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:10.796516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1960-26c4-4034-a0d3-a9a356e7711e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.796787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1960-26c4-4034-a0d3-a9a356e7711e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.797093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1960-26c4-4034-a0d3-a9a356e7711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.814523 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-33bc1960-26c4-4034-a0d3-a9a356e7711e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:10.815760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-33bc1960-26c4-4034-a0d3-a9a356e7711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:10.859787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:10.891010 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 61/116] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:10.891704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc1960-26c4-4034-a0d3-a9a356e7711e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:10.913010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654f81a-e1d3-4a5f-8278-c4cfb95ac5bb None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:10.953102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d207f-7a76-4f2b-a0aa-11a565dace8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:10.953677 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d207f-7a76-4f2b-a0aa-11a565dace8e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:10.953964 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d207f-7a76-4f2b-a0aa-11a565dace8e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:10.954244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d207f-7a76-4f2b-a0aa-11a565dace8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:10.996811 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc1960-26c4-4034-a0d3-a9a356e7711e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:11.024522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:11.032692 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a7bfc-4cef-45b5-8b1b-8b1faef2db1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:11.033593 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a7bfc-4cef-45b5-8b1b-8b1faef2db1c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:11.033770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d207f-7a76-4f2b-a0aa-11a565dace8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:11.033866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a7bfc-4cef-45b5-8b1b-8b1faef2db1c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:11.034140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a7bfc-4cef-45b5-8b1b-8b1faef2db1c None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:11.035226 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d207f-7a76-4f2b-a0aa-11a565dace8e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:11.035339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a7bfc-4cef-45b5-8b1b-8b1faef2db1c None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:11.036791 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a7bfc-4cef-45b5-8b1b-8b1faef2db1c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:11.038555 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 62/117] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:10 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:11.039696 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509c5a9-7001-4ebd-abd0-e732a24fa575 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:11.039982 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509c5a9-7001-4ebd-abd0-e732a24fa575 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:11.040259 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509c5a9-7001-4ebd-abd0-e732a24fa575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:11.058101 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f509c5a9-7001-4ebd-abd0-e732a24fa575 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:11.059276 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f509c5a9-7001-4ebd-abd0-e732a24fa575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:11.093640 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:11.140924 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 63/118] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:11.140924 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509c5a9-7001-4ebd-abd0-e732a24fa575 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:11.161321 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 56/119] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:11.162704 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d207f-7a76-4f2b-a0aa-11a565dace8e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:11.249960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509c5a9-7001-4ebd-abd0-e732a24fa575 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:11.258569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:11.265949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d207f-7a76-4f2b-a0aa-11a565dace8e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:11.286973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4b500-fc30-4206-870c-6aa7a603c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:11.287848 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4b500-fc30-4206-870c-6aa7a603c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:11.288133 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4b500-fc30-4206-870c-6aa7a603c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:11.288412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4b500-fc30-4206-870c-6aa7a603c5d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:11.304775 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4b500-fc30-4206-870c-6aa7a603c5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:11.306877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd27211-a770-4c11-8259-b4dcaaa75e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:11.307682 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd27211-a770-4c11-8259-b4dcaaa75e61 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:11.307968 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd27211-a770-4c11-8259-b4dcaaa75e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:11.308249 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd27211-a770-4c11-8259-b4dcaaa75e61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-fbe4b500-fc30-4206-870c-6aa7a603c5d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:11.314002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:11.314817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 64/120] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:11.321362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4b500-fc30-4206-870c-6aa7a603c5d6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:11.322048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd27211-a770-4c11-8259-b4dcaaa75e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-ccd27211-a770-4c11-8259-b4dcaaa75e61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:11.331491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:11.332361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 57/121] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:11.338172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd27211-a770-4c11-8259-b4dcaaa75e61 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:11.357490 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:11.436882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4b500-fc30-4206-870c-6aa7a603c5d6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:11.444418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd27211-a770-4c11-8259-b4dcaaa75e61 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:11.472623 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a58661-3414-4bbd-ba6e-d10495ec6a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:11.474341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a58661-3414-4bbd-ba6e-d10495ec6a6a None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:11.474631 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a58661-3414-4bbd-ba6e-d10495ec6a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:11.475014 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a58661-3414-4bbd-ba6e-d10495ec6a6a None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97/users/88fb21474f844e15aceece6e67aa28d0/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:11.477587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a58661-3414-4bbd-ba6e-d10495ec6a6a None admin] RBAC: Authorizing `identity:create_grant(project_id=6055d4c138374609abba19bcdd29bb97, user_id=88fb21474f844e15aceece6e67aa28d0, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:11.479182 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a58661-3414-4bbd-ba6e-d10495ec6a6a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:11.479721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94450e90-f313-417c-aa2b-dc28fa320f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:11.481095 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94450e90-f313-417c-aa2b-dc28fa320f11 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:11.481547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94450e90-f313-417c-aa2b-dc28fa320f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:11.481971 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94450e90-f313-417c-aa2b-dc28fa320f11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:11.492820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 65/122] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:01:11 2022] PUT /identity/v3/projects/6055d4c138374609abba19bcdd29bb97/users/88fb21474f844e15aceece6e67aa28d0/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:11.493447 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a58661-3414-4bbd-ba6e-d10495ec6a6a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:11.505321 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94450e90-f313-417c-aa2b-dc28fa320f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-94450e90-f313-417c-aa2b-dc28fa320f11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:11.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:11.518297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:11.519064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:11.522323 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 58/123] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:11.523417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94450e90-f313-417c-aa2b-dc28fa320f11 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:11.551332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:11.623582 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:11.639985 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a58661-3414-4bbd-ba6e-d10495ec6a6a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:11.653237 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94450e90-f313-417c-aa2b-dc28fa320f11 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:11.681858 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8b4e2-79e3-408f-a021-1eef343ab6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:11.682723 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8b4e2-79e3-408f-a021-1eef343ab6ab None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:11.683008 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8b4e2-79e3-408f-a021-1eef343ab6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:11.683284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8b4e2-79e3-408f-a021-1eef343ab6ab None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:11.684478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8b4e2-79e3-408f-a021-1eef343ab6ab None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:11.685986 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8b4e2-79e3-408f-a021-1eef343ab6ab None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:11.687890 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 66/124] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:11 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:11.692168 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8b4e2-79e3-408f-a021-1eef343ab6ab None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:11.699286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ddabd-3bef-416b-a93c-0dcce8ce4ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:11.699972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ddabd-3bef-416b-a93c-0dcce8ce4ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:11.700264 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ddabd-3bef-416b-a93c-0dcce8ce4ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:11.700551 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ddabd-3bef-416b-a93c-0dcce8ce4ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:11.701414 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ddabd-3bef-416b-a93c-0dcce8ce4ef7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:11.701735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ddabd-3bef-416b-a93c-0dcce8ce4ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:11.703147 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ddabd-3bef-416b-a93c-0dcce8ce4ef7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:11.713382 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 59/125] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:11.714054 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ddabd-3bef-416b-a93c-0dcce8ce4ef7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:11.816113 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:11.818679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8b4e2-79e3-408f-a021-1eef343ab6ab None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:11.839460 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ddabd-3bef-416b-a93c-0dcce8ce4ef7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:11.858378 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a02ae-dd0d-4372-8d91-af04b1a9f6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:11.859322 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a02ae-dd0d-4372-8d91-af04b1a9f6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:11.859755 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a02ae-dd0d-4372-8d91-af04b1a9f6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:11.860179 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a02ae-dd0d-4372-8d91-af04b1a9f6d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:11.861164 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a02ae-dd0d-4372-8d91-af04b1a9f6d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:11.861616 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a02ae-dd0d-4372-8d91-af04b1a9f6d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:11.863178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a02ae-dd0d-4372-8d91-af04b1a9f6d3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:11.872718 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 67/126] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:11.873850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a02ae-dd0d-4372-8d91-af04b1a9f6d3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:11.877486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3c59f-4412-4181-a30c-58289812aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:11.878328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3c59f-4412-4181-a30c-58289812aa55 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:11.878445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3c59f-4412-4181-a30c-58289812aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:11.878740 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3c59f-4412-4181-a30c-58289812aa55 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:11.879500 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3c59f-4412-4181-a30c-58289812aa55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:11.879819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3c59f-4412-4181-a30c-58289812aa55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:11.881855 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3c59f-4412-4181-a30c-58289812aa55 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:11.890658 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 60/127] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:11.891559 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3c59f-4412-4181-a30c-58289812aa55 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:11.902319 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:11.979569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a02ae-dd0d-4372-8d91-af04b1a9f6d3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:12.007723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3c59f-4412-4181-a30c-58289812aa55 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:12.016042 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc44a1-6a8c-421d-aa1c-a66147041fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:12.016950 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc44a1-6a8c-421d-aa1c-a66147041fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.017395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc44a1-6a8c-421d-aa1c-a66147041fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.017825 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc44a1-6a8c-421d-aa1c-a66147041fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:12.018810 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc44a1-6a8c-421d-aa1c-a66147041fc4 None admin] RBAC: Adding query filter params (role.id=5070a00cc59d4fb184e8235488c81f16, scope.project.id=6055d4c138374609abba19bcdd29bb97, user.id=2e6dbcd5bea34072844b4fcf82ef2577) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:12.019291 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc44a1-6a8c-421d-aa1c-a66147041fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:12.021010 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc44a1-6a8c-421d-aa1c-a66147041fc4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:12.028258 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 68/128] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:11 2022] GET /identity/v3/role_assignments?user.id=2e6dbcd5bea34072844b4fcf82ef2577&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=5070a00cc59d4fb184e8235488c81f16 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:12.029358 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc44a1-6a8c-421d-aa1c-a66147041fc4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:12.048218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b721d-1fc4-4f45-80ec-c6fb26e0bf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:12.049242 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b721d-1fc4-4f45-80ec-c6fb26e0bf1c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.049539 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b721d-1fc4-4f45-80ec-c6fb26e0bf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.049826 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b721d-1fc4-4f45-80ec-c6fb26e0bf1c None admin] PATH_INFO: `/v3/users/fdbc028fc50242ca95b20286bf2d6e57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:12.051281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b721d-1fc4-4f45-80ec-c6fb26e0bf1c None admin] RBAC: Authorizing `identity:get_user(user_id=fdbc028fc50242ca95b20286bf2d6e57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:12.053433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b721d-1fc4-4f45-80ec-c6fb26e0bf1c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:12.055348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 61/129] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:11 2022] GET /identity/v3/users/fdbc028fc50242ca95b20286bf2d6e57 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:12.056336 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b721d-1fc4-4f45-80ec-c6fb26e0bf1c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:12.069570 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:12.122747 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:12.138293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc44a1-6a8c-421d-aa1c-a66147041fc4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:12.174463 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b721d-1fc4-4f45-80ec-c6fb26e0bf1c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:12.174693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677051c5-6afa-49ab-ad8f-a5d03ef12014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:12.175403 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677051c5-6afa-49ab-ad8f-a5d03ef12014 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.175692 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677051c5-6afa-49ab-ad8f-a5d03ef12014 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.175971 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677051c5-6afa-49ab-ad8f-a5d03ef12014 None admin] PATH_INFO: `/v3/users/fdbc028fc50242ca95b20286bf2d6e57` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:12.177797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677051c5-6afa-49ab-ad8f-a5d03ef12014 None admin] RBAC: Authorizing `identity:get_user(user_id=fdbc028fc50242ca95b20286bf2d6e57)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:12.179329 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677051c5-6afa-49ab-ad8f-a5d03ef12014 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:12.181044 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 69/130] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:12 2022] GET /identity/v3/users/fdbc028fc50242ca95b20286bf2d6e57 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:12.181923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677051c5-6afa-49ab-ad8f-a5d03ef12014 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:12.216038 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620803e1-b9d1-404c-82e7-6c0620ca1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:12.217341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620803e1-b9d1-404c-82e7-6c0620ca1e5a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.217789 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620803e1-b9d1-404c-82e7-6c0620ca1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.218223 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620803e1-b9d1-404c-82e7-6c0620ca1e5a None admin] PATH_INFO: `/v3/users/fdbc028fc50242ca95b20286bf2d6e57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:12.220570 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620803e1-b9d1-404c-82e7-6c0620ca1e5a None admin] RBAC: Authorizing `identity:get_user(user_id=fdbc028fc50242ca95b20286bf2d6e57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:12.222261 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620803e1-b9d1-404c-82e7-6c0620ca1e5a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:12.224712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 62/131] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:12 2022] GET /identity/v3/users/fdbc028fc50242ca95b20286bf2d6e57 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:12.231579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620803e1-b9d1-404c-82e7-6c0620ca1e5a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:12.324715 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677051c5-6afa-49ab-ad8f-a5d03ef12014 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:12.347450 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:12.378666 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f036fc-ed3d-4392-b586-8e65d1c2781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:12.379599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f036fc-ed3d-4392-b586-8e65d1c2781f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.379892 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f036fc-ed3d-4392-b586-8e65d1c2781f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.380223 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f036fc-ed3d-4392-b586-8e65d1c2781f None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:12.383167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f036fc-ed3d-4392-b586-8e65d1c2781f None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:12.384658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f036fc-ed3d-4392-b586-8e65d1c2781f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:12.386618 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 70/132] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:12 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:12.388280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620803e1-b9d1-404c-82e7-6c0620ca1e5a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:12.393193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f036fc-ed3d-4392-b586-8e65d1c2781f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:12.437693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d2b94-7916-4cd7-95cb-662810f40977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:12.442645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d2b94-7916-4cd7-95cb-662810f40977 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.442939 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d2b94-7916-4cd7-95cb-662810f40977 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.443223 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d2b94-7916-4cd7-95cb-662810f40977 None admin] PATH_INFO: `/v3/projects/08afa27218fa471096ddd2a4a024b139` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:12.444499 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d2b94-7916-4cd7-95cb-662810f40977 None admin] RBAC: Authorizing `identity:get_project(project_id=08afa27218fa471096ddd2a4a024b139)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:12.447151 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d2b94-7916-4cd7-95cb-662810f40977 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:12.451535 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:12.453921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 63/133] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:12 2022] GET /identity/v3/projects/08afa27218fa471096ddd2a4a024b139 => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:12.455794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d2b94-7916-4cd7-95cb-662810f40977 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:12.585405 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d2b94-7916-4cd7-95cb-662810f40977 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:12.618238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f036fc-ed3d-4392-b586-8e65d1c2781f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:12.631784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c531d-ab9a-43dc-be08-09b7929dfa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:12.633067 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c531d-ab9a-43dc-be08-09b7929dfa46 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.633699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c531d-ab9a-43dc-be08-09b7929dfa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.634296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c531d-ab9a-43dc-be08-09b7929dfa46 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97/users/fdbc028fc50242ca95b20286bf2d6e57/roles/a11101f17a5c44e5b5454f2f8af57cf3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:12.636924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c531d-ab9a-43dc-be08-09b7929dfa46 None admin] RBAC: Authorizing `identity:create_grant(project_id=6055d4c138374609abba19bcdd29bb97, user_id=fdbc028fc50242ca95b20286bf2d6e57, role_id=a11101f17a5c44e5b5454f2f8af57cf3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:12.638611 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c531d-ab9a-43dc-be08-09b7929dfa46 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:12.667088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 64/134] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:01:12 2022] PUT /identity/v3/projects/6055d4c138374609abba19bcdd29bb97/users/fdbc028fc50242ca95b20286bf2d6e57/roles/a11101f17a5c44e5b5454f2f8af57cf3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:12.677398 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c531d-ab9a-43dc-be08-09b7929dfa46 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:12.686603 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:12.688298 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50f607-cb1f-44ae-b528-23f6bfe54f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:12.700230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50f607-cb1f-44ae-b528-23f6bfe54f5c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.701036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50f607-cb1f-44ae-b528-23f6bfe54f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.701618 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50f607-cb1f-44ae-b528-23f6bfe54f5c None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:12.703605 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50f607-cb1f-44ae-b528-23f6bfe54f5c None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:12.706162 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50f607-cb1f-44ae-b528-23f6bfe54f5c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:12.709048 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 71/135] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:12 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:12.721665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50f607-cb1f-44ae-b528-23f6bfe54f5c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:12.908008 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:12.913904 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50f607-cb1f-44ae-b528-23f6bfe54f5c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:12.929671 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c531d-ab9a-43dc-be08-09b7929dfa46 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:12.956588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e24a1-1324-44ab-8961-d0469cf6b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:12.957576 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e24a1-1324-44ab-8961-d0469cf6b8c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.957873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e24a1-1324-44ab-8961-d0469cf6b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.958183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e24a1-1324-44ab-8961-d0469cf6b8c2 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97/users/fdbc028fc50242ca95b20286bf2d6e57/roles/14df33950256418dae713180ece879af` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:12.961438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e24a1-1324-44ab-8961-d0469cf6b8c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6055d4c138374609abba19bcdd29bb97, user_id=fdbc028fc50242ca95b20286bf2d6e57, role_id=14df33950256418dae713180ece879af)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:12.962927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e24a1-1324-44ab-8961-d0469cf6b8c2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:12.976260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f2ee2-9d8c-4e00-8cb5-674a252b6e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:12.977551 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f2ee2-9d8c-4e00-8cb5-674a252b6e95 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.978191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f2ee2-9d8c-4e00-8cb5-674a252b6e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.978788 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f2ee2-9d8c-4e00-8cb5-674a252b6e95 None admin] PATH_INFO: `/v3/projects/08afa27218fa471096ddd2a4a024b139/users/fdbc028fc50242ca95b20286bf2d6e57/roles/14df33950256418dae713180ece879af` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:12.981315 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f2ee2-9d8c-4e00-8cb5-674a252b6e95 None admin] RBAC: Authorizing `identity:create_grant(project_id=08afa27218fa471096ddd2a4a024b139, user_id=fdbc028fc50242ca95b20286bf2d6e57, role_id=14df33950256418dae713180ece879af)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:12.982864 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 72/136] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:01:12 2022] PUT /identity/v3/projects/6055d4c138374609abba19bcdd29bb97/users/fdbc028fc50242ca95b20286bf2d6e57/roles/14df33950256418dae713180ece879af => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:12.989222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ae5f-bd81-4aa0-951a-6a231676a5f7 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.989222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ae5f-bd81-4aa0-951a-6a231676a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.989222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ae5f-bd81-4aa0-951a-6a231676a5f7 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:12.989222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 73/137] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:12.990522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f2ee2-9d8c-4e00-8cb5-674a252b6e95 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:12.992545 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f06b-416d-45be-a3f9-343b375fb367 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:12.992841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f06b-416d-45be-a3f9-343b375fb367 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:12.994842 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f06b-416d-45be-a3f9-343b375fb367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:13.015661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9178f06b-416d-45be-a3f9-343b375fb367 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:13.017836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9178f06b-416d-45be-a3f9-343b375fb367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:13.019351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 65/138] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:01:12 2022] PUT /identity/v3/projects/08afa27218fa471096ddd2a4a024b139/users/fdbc028fc50242ca95b20286bf2d6e57/roles/14df33950256418dae713180ece879af => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:13.103864 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 74/139] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:13.129359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f2ee2-9d8c-4e00-8cb5-674a252b6e95 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:13.232783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:13.280604 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f2ee2-9d8c-4e00-8cb5-674a252b6e95 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:13.326311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf32e30-2d23-4705-a145-29797c1a509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:13.327505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32e30-2d23-4705-a145-29797c1a509f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:13.328005 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32e30-2d23-4705-a145-29797c1a509f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:13.328508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32e30-2d23-4705-a145-29797c1a509f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:13.329997 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf32e30-2d23-4705-a145-29797c1a509f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:13.331682 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf32e30-2d23-4705-a145-29797c1a509f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:13.334178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 66/140] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:13.340054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178f06b-416d-45be-a3f9-343b375fb367 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:13.430592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:13.451485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178f06b-416d-45be-a3f9-343b375fb367 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:13.488371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6c481-0c12-44dd-8f6e-a7d1fa7de549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:13.489458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6c481-0c12-44dd-8f6e-a7d1fa7de549 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:13.489967 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6c481-0c12-44dd-8f6e-a7d1fa7de549 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:13.490465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6c481-0c12-44dd-8f6e-a7d1fa7de549 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:13.491393 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6c481-0c12-44dd-8f6e-a7d1fa7de549 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:13.493186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6c481-0c12-44dd-8f6e-a7d1fa7de549 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:13.519288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 75/141] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:01:13 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:13.970387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14916abd-cedd-4ee7-9dbf-213711fc2f94 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:13.970898 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14916abd-cedd-4ee7-9dbf-213711fc2f94 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:13.971007 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14916abd-cedd-4ee7-9dbf-213711fc2f94 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:13.972360 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 67/142] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:13.978303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130ac82-9486-4691-910c-020cbad203c5 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:13.979134 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130ac82-9486-4691-910c-020cbad203c5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:13.979617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130ac82-9486-4691-910c-020cbad203c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:14.004191 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c130ac82-9486-4691-910c-020cbad203c5 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:14.006389 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c130ac82-9486-4691-910c-020cbad203c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:14.087215 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 76/143] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:14.112336 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14916abd-cedd-4ee7-9dbf-213711fc2f94 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:14.257583 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14916abd-cedd-4ee7-9dbf-213711fc2f94 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:14.309924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:14.314994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3993-a526-4492-979d-ddb89a11e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:14.315815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3993-a526-4492-979d-ddb89a11e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:14.316103 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3993-a526-4492-979d-ddb89a11e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:14.316386 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf3993-a526-4492-979d-ddb89a11e3a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:14.332484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf3993-a526-4492-979d-ddb89a11e3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-86cf3993-a526-4492-979d-ddb89a11e3a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:14.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:14.341798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:14.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 68/144] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:01:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:14.349498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130ac82-9486-4691-910c-020cbad203c5 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:14.439796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:14.479121 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130ac82-9486-4691-910c-020cbad203c5 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:14.519729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1e687-b044-4c5c-bf02-e53901fb4a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:14.520338 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1e687-b044-4c5c-bf02-e53901fb4a0d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:14.520655 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1e687-b044-4c5c-bf02-e53901fb4a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:14.521483 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1e687-b044-4c5c-bf02-e53901fb4a0d None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:14.522251 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1e687-b044-4c5c-bf02-e53901fb4a0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:14.522562 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1e687-b044-4c5c-bf02-e53901fb4a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:14.523953 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1e687-b044-4c5c-bf02-e53901fb4a0d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:14.532610 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 77/145] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:14.541368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3993-a526-4492-979d-ddb89a11e3a5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:14.696061 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf3993-a526-4492-979d-ddb89a11e3a5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:14.738933 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3cfbc-eb6b-4fb2-8beb-7c0b66e8260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:14.739868 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3cfbc-eb6b-4fb2-8beb-7c0b66e8260b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:14.740159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3cfbc-eb6b-4fb2-8beb-7c0b66e8260b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:14.740441 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3cfbc-eb6b-4fb2-8beb-7c0b66e8260b None admin] PATH_INFO: `/v3/users/88fb21474f844e15aceece6e67aa28d0` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:14.741662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3cfbc-eb6b-4fb2-8beb-7c0b66e8260b None admin] RBAC: Authorizing `identity:get_user(user_id=88fb21474f844e15aceece6e67aa28d0)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:14.743143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3cfbc-eb6b-4fb2-8beb-7c0b66e8260b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:14.744967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 69/146] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:14 2022] GET /identity/v3/users/88fb21474f844e15aceece6e67aa28d0 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:14.750543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1e687-b044-4c5c-bf02-e53901fb4a0d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:14.888234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1e687-b044-4c5c-bf02-e53901fb4a0d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:14.921448 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:14.929432 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cedc4-9b3d-4fd2-81e7-2844d2fa95bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:14.930537 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cedc4-9b3d-4fd2-81e7-2844d2fa95bb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:14.930826 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cedc4-9b3d-4fd2-81e7-2844d2fa95bb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:14.931110 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cedc4-9b3d-4fd2-81e7-2844d2fa95bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:15.010236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cedc4-9b3d-4fd2-81e7-2844d2fa95bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:15.011735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cedc4-9b3d-4fd2-81e7-2844d2fa95bb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:15.123757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 78/147] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:15.129277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cedc4-9b3d-4fd2-81e7-2844d2fa95bb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:15.129852 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7be12-9770-4dac-b2a7-3a50bbb60886 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:15.130856 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7be12-9770-4dac-b2a7-3a50bbb60886 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:15.130934 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7be12-9770-4dac-b2a7-3a50bbb60886 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:15.132586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 70/148] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:15.138651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d37c8c-201c-409f-b534-54452b9a27a2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:15.138886 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d37c8c-201c-409f-b534-54452b9a27a2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:15.139172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d37c8c-201c-409f-b534-54452b9a27a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:15.166242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:15.172736 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f3d37c8c-201c-409f-b534-54452b9a27a2 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:15.173997 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f3d37c8c-201c-409f-b534-54452b9a27a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:15.237203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cedc4-9b3d-4fd2-81e7-2844d2fa95bb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:15.279551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79fedd-fbfb-4e54-b0bb-c4ca92c5cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:15.280448 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79fedd-fbfb-4e54-b0bb-c4ca92c5cf10 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:15.280736 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79fedd-fbfb-4e54-b0bb-c4ca92c5cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:15.281048 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79fedd-fbfb-4e54-b0bb-c4ca92c5cf10 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:15.282330 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79fedd-fbfb-4e54-b0bb-c4ca92c5cf10 None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:15.286061 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79fedd-fbfb-4e54-b0bb-c4ca92c5cf10 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:15.286205 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:15.289186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 79/149] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:15 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:15.301970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79fedd-fbfb-4e54-b0bb-c4ca92c5cf10 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:15.337334 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 71/150] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:15.378453 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d37c8c-201c-409f-b534-54452b9a27a2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:15.425401 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:15.435194 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79fedd-fbfb-4e54-b0bb-c4ca92c5cf10 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:15.485624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172a3f7-b510-4187-ac03-c11f3d89d45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:15.486550 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172a3f7-b510-4187-ac03-c11f3d89d45e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:15.486841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172a3f7-b510-4187-ac03-c11f3d89d45e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:15.487125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172a3f7-b510-4187-ac03-c11f3d89d45e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:15.487988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172a3f7-b510-4187-ac03-c11f3d89d45e None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=6055d4c138374609abba19bcdd29bb97, user.id=88fb21474f844e15aceece6e67aa28d0) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:15.488307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172a3f7-b510-4187-ac03-c11f3d89d45e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:15.490213 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172a3f7-b510-4187-ac03-c11f3d89d45e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:15.497081 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 80/151] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:15 2022] GET /identity/v3/role_assignments?user.id=88fb21474f844e15aceece6e67aa28d0&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:15.638410 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d37c8c-201c-409f-b534-54452b9a27a2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:15.685973 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ee1d6-714f-4ee9-89cd-e1ccb1d625ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:15.686701 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee1d6-714f-4ee9-89cd-e1ccb1d625ef None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:15.686986 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee1d6-714f-4ee9-89cd-e1ccb1d625ef None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:15.687264 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee1d6-714f-4ee9-89cd-e1ccb1d625ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:15.699426 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ee1d6-714f-4ee9-89cd-e1ccb1d625ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-538ee1d6-714f-4ee9-89cd-e1ccb1d625ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:15.707309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:15.708668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:15.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 72/152] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:15.714934 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172a3f7-b510-4187-ac03-c11f3d89d45e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:15.831814 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172a3f7-b510-4187-ac03-c11f3d89d45e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:15.878092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4d083-bbd9-4353-a0e7-6f157cd5c05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:15.878774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4d083-bbd9-4353-a0e7-6f157cd5c05e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:15.879106 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4d083-bbd9-4353-a0e7-6f157cd5c05e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:15.879389 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4d083-bbd9-4353-a0e7-6f157cd5c05e None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:15.880674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4d083-bbd9-4353-a0e7-6f157cd5c05e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:15.881010 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4d083-bbd9-4353-a0e7-6f157cd5c05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:15.882420 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4d083-bbd9-4353-a0e7-6f157cd5c05e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:15.897570 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 81/153] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:15.903178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ee1d6-714f-4ee9-89cd-e1ccb1d625ef None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:15.967048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:16.024026 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ee1d6-714f-4ee9-89cd-e1ccb1d625ef None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:16.058023 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6964e-ed20-40c2-b9ab-e77216e3543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:16.058975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6964e-ed20-40c2-b9ab-e77216e3543b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:16.059258 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6964e-ed20-40c2-b9ab-e77216e3543b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:16.059535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6964e-ed20-40c2-b9ab-e77216e3543b None admin] PATH_INFO: `/v3/users/2e6dbcd5bea34072844b4fcf82ef2577` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:16.060754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6964e-ed20-40c2-b9ab-e77216e3543b None admin] RBAC: Authorizing `identity:get_user(user_id=2e6dbcd5bea34072844b4fcf82ef2577)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:16.062242 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6964e-ed20-40c2-b9ab-e77216e3543b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:16.064168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 73/154] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:15 2022] GET /identity/v3/users/2e6dbcd5bea34072844b4fcf82ef2577 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:16.070053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4d083-bbd9-4353-a0e7-6f157cd5c05e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:16.097156 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:16.189630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4d083-bbd9-4353-a0e7-6f157cd5c05e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:16.196277 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea8f0-d4d0-436a-bc03-ebfff3679a51 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:16.196739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea8f0-d4d0-436a-bc03-ebfff3679a51 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:16.196838 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea8f0-d4d0-436a-bc03-ebfff3679a51 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:16.198234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 74/155] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:16.203545 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a011d5-62a1-4a1e-93fb-37c45504dfe9 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:16.203833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a011d5-62a1-4a1e-93fb-37c45504dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:16.204112 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a011d5-62a1-4a1e-93fb-37c45504dfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:16.225699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-19a011d5-62a1-4a1e-93fb-37c45504dfe9 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:16.226833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-19a011d5-62a1-4a1e-93fb-37c45504dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:16.260424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90858e-abd6-4fea-8b31-5eba2116a9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:16.261333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90858e-abd6-4fea-8b31-5eba2116a9bc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:16.261680 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90858e-abd6-4fea-8b31-5eba2116a9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:16.261959 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90858e-abd6-4fea-8b31-5eba2116a9bc None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:16.263220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90858e-abd6-4fea-8b31-5eba2116a9bc None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:16.264679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90858e-abd6-4fea-8b31-5eba2116a9bc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:16.266587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 82/156] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:16 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:16.279417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90858e-abd6-4fea-8b31-5eba2116a9bc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:16.362987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 75/157] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:16.394644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a011d5-62a1-4a1e-93fb-37c45504dfe9 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:16.455397 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:16.477898 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90858e-abd6-4fea-8b31-5eba2116a9bc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:16.481712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:16.538567 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79232818-6ec0-45c0-97f5-ee70436bace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:16.539752 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79232818-6ec0-45c0-97f5-ee70436bace1 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:16.540186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79232818-6ec0-45c0-97f5-ee70436bace1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:16.540712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79232818-6ec0-45c0-97f5-ee70436bace1 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97/users/2e6dbcd5bea34072844b4fcf82ef2577/roles/5070a00cc59d4fb184e8235488c81f16` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:16.542911 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79232818-6ec0-45c0-97f5-ee70436bace1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6055d4c138374609abba19bcdd29bb97, user_id=2e6dbcd5bea34072844b4fcf82ef2577, role_id=5070a00cc59d4fb184e8235488c81f16)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:16.544778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79232818-6ec0-45c0-97f5-ee70436bace1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:16.576233 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a011d5-62a1-4a1e-93fb-37c45504dfe9 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:16.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 83/158] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:01:16 2022] PUT /identity/v3/projects/6055d4c138374609abba19bcdd29bb97/users/2e6dbcd5bea34072844b4fcf82ef2577/roles/5070a00cc59d4fb184e8235488c81f16 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:16.627240 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163101f-2ec5-4fbe-b1d7-b431038b7261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:16.628488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163101f-2ec5-4fbe-b1d7-b431038b7261 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:16.628994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163101f-2ec5-4fbe-b1d7-b431038b7261 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:16.629489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163101f-2ec5-4fbe-b1d7-b431038b7261 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:16.647114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163101f-2ec5-4fbe-b1d7-b431038b7261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0163101f-2ec5-4fbe-b1d7-b431038b7261 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:16.655887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:16.656795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:16.657607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:16.659961 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 76/159] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:16.666372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79232818-6ec0-45c0-97f5-ee70436bace1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:16.769474 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74d8a-785c-4d9b-b1d1-28612509da50 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:16.770130 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74d8a-785c-4d9b-b1d1-28612509da50 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:16.771196 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74d8a-785c-4d9b-b1d1-28612509da50 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:16.773063 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 77/160] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:16.778488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec221313-11e2-4377-9ae4-e1986c8b07f9 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:16.779069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec221313-11e2-4377-9ae4-e1986c8b07f9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:16.779693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec221313-11e2-4377-9ae4-e1986c8b07f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:16.808686 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ec221313-11e2-4377-9ae4-e1986c8b07f9 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:16.810461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ec221313-11e2-4377-9ae4-e1986c8b07f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:16.838087 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79232818-6ec0-45c0-97f5-ee70436bace1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:16.906176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 78/161] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:16.918473 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547bb70-17ea-48ad-ba1e-44bce84db813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:16.919414 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547bb70-17ea-48ad-ba1e-44bce84db813 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:16.919700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547bb70-17ea-48ad-ba1e-44bce84db813 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:16.919977 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547bb70-17ea-48ad-ba1e-44bce84db813 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:16.920732 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547bb70-17ea-48ad-ba1e-44bce84db813 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:16.921068 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547bb70-17ea-48ad-ba1e-44bce84db813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:16.922456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547bb70-17ea-48ad-ba1e-44bce84db813 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:16.935331 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 84/162] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:16.940813 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec221313-11e2-4377-9ae4-e1986c8b07f9 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:16.944347 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547bb70-17ea-48ad-ba1e-44bce84db813 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:16.974973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:17.021316 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:17.180753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547bb70-17ea-48ad-ba1e-44bce84db813 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:17.187181 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec221313-11e2-4377-9ae4-e1986c8b07f9 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:17.247844 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef59c7-8b9f-40b9-9184-42461a3172c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:17.249034 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef59c7-8b9f-40b9-9184-42461a3172c9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:17.249518 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef59c7-8b9f-40b9-9184-42461a3172c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:17.250053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef59c7-8b9f-40b9-9184-42461a3172c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:17.281678 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef59c7-8b9f-40b9-9184-42461a3172c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-a2ef59c7-8b9f-40b9-9184-42461a3172c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:17.296928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:17.297901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:17.298672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:17.301637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 85/163] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:17.303242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aca37-ce3a-410f-a434-400cbaaf4d04 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:17.303742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aca37-ce3a-410f-a434-400cbaaf4d04 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:17.304235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aca37-ce3a-410f-a434-400cbaaf4d04 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:17.306385 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 86/164] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:17.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6e37d-4148-42bf-af88-24a703563cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:17.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e37d-4148-42bf-af88-24a703563cab None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:17.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e37d-4148-42bf-af88-24a703563cab None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:17.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e37d-4148-42bf-af88-24a703563cab None admin] PATH_INFO: `/v3/users/fdbc028fc50242ca95b20286bf2d6e57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:17.313035 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c27f4-a910-4b2e-9f60-1d8985dc0a7e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:17.313554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c27f4-a910-4b2e-9f60-1d8985dc0a7e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:17.313834 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6e37d-4148-42bf-af88-24a703563cab None admin] RBAC: Authorizing `identity:get_user(user_id=fdbc028fc50242ca95b20286bf2d6e57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:17.314362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c27f4-a910-4b2e-9f60-1d8985dc0a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:17.315102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6e37d-4148-42bf-af88-24a703563cab None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:17.318120 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 79/165] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:16 2022] GET /identity/v3/users/fdbc028fc50242ca95b20286bf2d6e57 => generated 275 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:17.318501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6e37d-4148-42bf-af88-24a703563cab None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:17.342888 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-113c27f4-a910-4b2e-9f60-1d8985dc0a7e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:17.344533 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-113c27f4-a910-4b2e-9f60-1d8985dc0a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:17.461161 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 87/166] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:17.462103 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c27f4-a910-4b2e-9f60-1d8985dc0a7e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:17.481282 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:17.522815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6e37d-4148-42bf-af88-24a703563cab None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:17.537299 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:17.584484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a6562-c346-4d09-b37b-1a37092eb287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:17.585197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a6562-c346-4d09-b37b-1a37092eb287 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:17.585482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a6562-c346-4d09-b37b-1a37092eb287 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:17.585759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a6562-c346-4d09-b37b-1a37092eb287 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:17.586515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a6562-c346-4d09-b37b-1a37092eb287 None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:17.586821 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a6562-c346-4d09-b37b-1a37092eb287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:17.588209 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a6562-c346-4d09-b37b-1a37092eb287 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:17.609974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 80/167] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:17.610829 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a6562-c346-4d09-b37b-1a37092eb287 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:17.691633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c27f4-a910-4b2e-9f60-1d8985dc0a7e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:17.790379 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a6562-c346-4d09-b37b-1a37092eb287 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:17.802626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9750cc-c599-4a09-970f-7956f216ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:17.803300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9750cc-c599-4a09-970f-7956f216ed1c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:17.803586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9750cc-c599-4a09-970f-7956f216ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:17.803861 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9750cc-c599-4a09-970f-7956f216ed1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:17.863586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83cbd0-95a1-4189-8e63-b0a567881919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:17.865005 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cbd0-95a1-4189-8e63-b0a567881919 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:17.865297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cbd0-95a1-4189-8e63-b0a567881919 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:17.865578 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cbd0-95a1-4189-8e63-b0a567881919 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:17.887067 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83cbd0-95a1-4189-8e63-b0a567881919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-ab83cbd0-95a1-4189-8e63-b0a567881919 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:17.900518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:17.901537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:17.902295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 81/168] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:17.902931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83cbd0-95a1-4189-8e63-b0a567881919 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:17.965282 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:17.986918 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9750cc-c599-4a09-970f-7956f216ed1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:17.988490 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9750cc-c599-4a09-970f-7956f216ed1c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:17.990911 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:18.055325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83cbd0-95a1-4189-8e63-b0a567881919 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:18.121973 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf77e7-ca49-43eb-9d86-11b836d9268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:18.123263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf77e7-ca49-43eb-9d86-11b836d9268f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:18.123543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf77e7-ca49-43eb-9d86-11b836d9268f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:18.123812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf77e7-ca49-43eb-9d86-11b836d9268f None admin] PATH_INFO: `/v3/users/fdbc028fc50242ca95b20286bf2d6e57` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:18.133062 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf77e7-ca49-43eb-9d86-11b836d9268f None admin] RBAC: Authorizing `identity:get_user(user_id=fdbc028fc50242ca95b20286bf2d6e57)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:18.133062 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf77e7-ca49-43eb-9d86-11b836d9268f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:18.133062 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 82/169] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:17 2022] GET /identity/v3/users/fdbc028fc50242ca95b20286bf2d6e57 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:18.133062 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf77e7-ca49-43eb-9d86-11b836d9268f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:18.168026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 88/170] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:18.169709 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb0d1b-1617-428f-9487-fc2c2b7849f3 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:18.170002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb0d1b-1617-428f-9487-fc2c2b7849f3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:18.170283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb0d1b-1617-428f-9487-fc2c2b7849f3 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:18.172775 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 89/171] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:18.179289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb0d1b-1617-428f-9487-fc2c2b7849f3 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:18.335885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:18.344070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf77e7-ca49-43eb-9d86-11b836d9268f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:18.375401 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb0d1b-1617-428f-9487-fc2c2b7849f3 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:18.378174 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:18.412403 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f0ad6-e360-4fd2-a6b5-34a5260f0c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:18.413110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f0ad6-e360-4fd2-a6b5-34a5260f0c83 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:18.413386 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f0ad6-e360-4fd2-a6b5-34a5260f0c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:18.413668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f0ad6-e360-4fd2-a6b5-34a5260f0c83 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:18.414422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f0ad6-e360-4fd2-a6b5-34a5260f0c83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:18.414735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f0ad6-e360-4fd2-a6b5-34a5260f0c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:18.416137 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f0ad6-e360-4fd2-a6b5-34a5260f0c83 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:18.436717 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 83/172] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:18.437421 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f0ad6-e360-4fd2-a6b5-34a5260f0c83 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:18.448974 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edd3c3-ac02-4a05-9204-92bcafc00441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:18.449644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edd3c3-ac02-4a05-9204-92bcafc00441 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:18.449932 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edd3c3-ac02-4a05-9204-92bcafc00441 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:18.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edd3c3-ac02-4a05-9204-92bcafc00441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:18.548829 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edd3c3-ac02-4a05-9204-92bcafc00441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:18.550428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edd3c3-ac02-4a05-9204-92bcafc00441 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:18.563864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f0ad6-e360-4fd2-a6b5-34a5260f0c83 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:18.607301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d14b-de35-463a-bbee-bc3ab83a6f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:18.608086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d14b-de35-463a-bbee-bc3ab83a6f5e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:18.608370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d14b-de35-463a-bbee-bc3ab83a6f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:18.608645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d14b-de35-463a-bbee-bc3ab83a6f5e None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:18.609845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413d14b-de35-463a-bbee-bc3ab83a6f5e None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:18.611299 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413d14b-de35-463a-bbee-bc3ab83a6f5e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:18.613358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 84/173] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:18 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:18.614548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a5c1-a864-4b14-8beb-83f8e377ce7a None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:18.614829 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a5c1-a864-4b14-8beb-83f8e377ce7a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:18.615102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a5c1-a864-4b14-8beb-83f8e377ce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:18.631878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-08c3a5c1-a864-4b14-8beb-83f8e377ce7a None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:18.633483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-08c3a5c1-a864-4b14-8beb-83f8e377ce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:18.654819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:18.662203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 90/174] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:18.663290 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edd3c3-ac02-4a05-9204-92bcafc00441 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:18.665830 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:18.708933 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 85/175] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:18.709260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7059-ce39-43da-926d-5cf52b3fb595 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:18.709508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7059-ce39-43da-926d-5cf52b3fb595 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:18.709783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7059-ce39-43da-926d-5cf52b3fb595 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:18.711182 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 86/176] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:18.712098 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c9aec-f30d-4f06-83b8-4c9161f981cd None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:18.712376 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c9aec-f30d-4f06-83b8-4c9161f981cd None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:18.712645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c9aec-f30d-4f06-83b8-4c9161f981cd None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:18.717388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 87/177] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:18.717388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c9aec-f30d-4f06-83b8-4c9161f981cd None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:18.786009 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edd3c3-ac02-4a05-9204-92bcafc00441 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:18.824002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe2358-b569-4f25-b36c-dd0736cbc249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:18.824882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe2358-b569-4f25-b36c-dd0736cbc249 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:18.825190 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe2358-b569-4f25-b36c-dd0736cbc249 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:18.825466 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe2358-b569-4f25-b36c-dd0736cbc249 None admin] PATH_INFO: `/v3/users/fdbc028fc50242ca95b20286bf2d6e57` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:18.826675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe2358-b569-4f25-b36c-dd0736cbc249 None admin] RBAC: Authorizing `identity:get_user(user_id=fdbc028fc50242ca95b20286bf2d6e57)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:18.828141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe2358-b569-4f25-b36c-dd0736cbc249 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:18.829816 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 91/178] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:18 2022] GET /identity/v3/users/fdbc028fc50242ca95b20286bf2d6e57 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:18.830577 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe2358-b569-4f25-b36c-dd0736cbc249 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:18.831048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c9aec-f30d-4f06-83b8-4c9161f981cd None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:18.870817 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6befe-675e-4811-8eef-33e821e4d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:18.871783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6befe-675e-4811-8eef-33e821e4d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:18.872306 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6befe-675e-4811-8eef-33e821e4d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:18.872769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6befe-675e-4811-8eef-33e821e4d0d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:18.873930 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6befe-675e-4811-8eef-33e821e4d0d2 None admin] RBAC: Adding query filter params (role.id=a11101f17a5c44e5b5454f2f8af57cf3, scope.project.id=6055d4c138374609abba19bcdd29bb97, user.id=fdbc028fc50242ca95b20286bf2d6e57) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:18.874254 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6befe-675e-4811-8eef-33e821e4d0d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:18.875848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6befe-675e-4811-8eef-33e821e4d0d2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:18.882233 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 88/179] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:18 2022] GET /identity/v3/role_assignments?user.id=fdbc028fc50242ca95b20286bf2d6e57&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=a11101f17a5c44e5b5454f2f8af57cf3 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:18.883432 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a81a80-1dc5-4a90-bc13-bf41dffa402f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:18.883744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a81a80-1dc5-4a90-bc13-bf41dffa402f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:18.884026 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a81a80-1dc5-4a90-bc13-bf41dffa402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:18.904392 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c0a81a80-1dc5-4a90-bc13-bf41dffa402f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:18.905672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c0a81a80-1dc5-4a90-bc13-bf41dffa402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:18.912560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:18.925229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:18.953541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe2358-b569-4f25-b36c-dd0736cbc249 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:18.998467 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262486-d946-494e-97e0-f97fc84d38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:18.999804 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262486-d946-494e-97e0-f97fc84d38b3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.000264 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262486-d946-494e-97e0-f97fc84d38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.000821 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02262486-d946-494e-97e0-f97fc84d38b3 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.002644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02262486-d946-494e-97e0-f97fc84d38b3 None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:19.003170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 89/180] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:19.004646 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02262486-d946-494e-97e0-f97fc84d38b3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:19.006726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 92/181] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:18 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:19.007705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262486-d946-494e-97e0-f97fc84d38b3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:19.009609 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c6b4-65f8-454a-913a-6e63d2c6992e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.009908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c6b4-65f8-454a-913a-6e63d2c6992e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.010193 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c6b4-65f8-454a-913a-6e63d2c6992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.042850 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0719c6b4-65f8-454a-913a-6e63d2c6992e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:19.044342 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0719c6b4-65f8-454a-913a-6e63d2c6992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:19.140945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 90/182] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:19.141682 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719c6b4-65f8-454a-913a-6e63d2c6992e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:19.143796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02262486-d946-494e-97e0-f97fc84d38b3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:19.184033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf613bd1-6f09-46f7-9b2b-d97938e367a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:19.184837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf613bd1-6f09-46f7-9b2b-d97938e367a0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.185159 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf613bd1-6f09-46f7-9b2b-d97938e367a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.185442 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf613bd1-6f09-46f7-9b2b-d97938e367a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.193760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:19.198705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf613bd1-6f09-46f7-9b2b-d97938e367a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-cf613bd1-6f09-46f7-9b2b-d97938e367a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:19.206372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:19.207289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:19.208339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 93/183] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:19.209204 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf613bd1-6f09-46f7-9b2b-d97938e367a0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:19.236545 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:19.256277 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719c6b4-65f8-454a-913a-6e63d2c6992e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:19.294785 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e9d04-148a-4b98-b3f1-cee3ed8e142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:19.296231 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e9d04-148a-4b98-b3f1-cee3ed8e142f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.296231 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e9d04-148a-4b98-b3f1-cee3ed8e142f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.296362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e9d04-148a-4b98-b3f1-cee3ed8e142f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.309088 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf613bd1-6f09-46f7-9b2b-d97938e367a0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:19.341927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f3170-ac6a-4180-bedb-0a1b9669f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:19.342578 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3170-ac6a-4180-bedb-0a1b9669f8dc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.342885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3170-ac6a-4180-bedb-0a1b9669f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.343169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f3170-ac6a-4180-bedb-0a1b9669f8dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.343993 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f3170-ac6a-4180-bedb-0a1b9669f8dc None admin] RBAC: Adding query filter params (role.id=14df33950256418dae713180ece879af, scope.project.id=6055d4c138374609abba19bcdd29bb97, user.id=fdbc028fc50242ca95b20286bf2d6e57) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:19.344305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f3170-ac6a-4180-bedb-0a1b9669f8dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:19.345765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f3170-ac6a-4180-bedb-0a1b9669f8dc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:19.351632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 94/184] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:19 2022] GET /identity/v3/role_assignments?user.id=fdbc028fc50242ca95b20286bf2d6e57&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=14df33950256418dae713180ece879af => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:19.352203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f3170-ac6a-4180-bedb-0a1b9669f8dc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:19.365229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e9d04-148a-4b98-b3f1-cee3ed8e142f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:19.366792 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e9d04-148a-4b98-b3f1-cee3ed8e142f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:19.436770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:19.459217 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:19.482659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f3170-ac6a-4180-bedb-0a1b9669f8dc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:19.488105 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 91/185] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:19.488105 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e9d04-148a-4b98-b3f1-cee3ed8e142f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:19.534462 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17344cea-9558-4067-b9cd-54657c36f4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:19.535344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344cea-9558-4067-b9cd-54657c36f4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.535641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344cea-9558-4067-b9cd-54657c36f4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.535919 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17344cea-9558-4067-b9cd-54657c36f4b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.549043 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17344cea-9558-4067-b9cd-54657c36f4b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-17344cea-9558-4067-b9cd-54657c36f4b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:19.558217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:19.559112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:19.559881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 95/186] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:19.561650 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6dbaa-cbc3-4857-9c7f-86ba3300e53e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.561944 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6dbaa-cbc3-4857-9c7f-86ba3300e53e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.562225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6dbaa-cbc3-4857-9c7f-86ba3300e53e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.563682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 96/187] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:19.568751 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6dbaa-cbc3-4857-9c7f-86ba3300e53e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:19.602788 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e9d04-148a-4b98-b3f1-cee3ed8e142f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:19.637762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0e4e4-857e-479f-b01e-91d17160a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:19.640019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0e4e4-857e-479f-b01e-91d17160a6dd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.640019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0e4e4-857e-479f-b01e-91d17160a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.640019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0e4e4-857e-479f-b01e-91d17160a6dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.640312 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0e4e4-857e-479f-b01e-91d17160a6dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:19.641821 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0e4e4-857e-479f-b01e-91d17160a6dd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:19.643477 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 92/188] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:19.644252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0e4e4-857e-479f-b01e-91d17160a6dd None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:19.674023 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6dbaa-cbc3-4857-9c7f-86ba3300e53e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:19.693663 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:19.695853 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:19.707438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62684ae-a022-459a-8b03-9c643bf1aee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:19.708680 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62684ae-a022-459a-8b03-9c643bf1aee6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.709001 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62684ae-a022-459a-8b03-9c643bf1aee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.709281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62684ae-a022-459a-8b03-9c643bf1aee6 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.710024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62684ae-a022-459a-8b03-9c643bf1aee6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:19.710331 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62684ae-a022-459a-8b03-9c643bf1aee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:19.711725 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62684ae-a022-459a-8b03-9c643bf1aee6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:19.720215 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 97/189] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:19.721044 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62684ae-a022-459a-8b03-9c643bf1aee6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:19.747357 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0e4e4-857e-479f-b01e-91d17160a6dd None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:19.780629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31d288-c687-4502-9543-53cc733b3be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:19.781525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d288-c687-4502-9543-53cc733b3be1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.781810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d288-c687-4502-9543-53cc733b3be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.782088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d288-c687-4502-9543-53cc733b3be1 None admin] PATH_INFO: `/v3/projects/08afa27218fa471096ddd2a4a024b139` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.783269 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31d288-c687-4502-9543-53cc733b3be1 None admin] RBAC: Authorizing `identity:get_project(project_id=08afa27218fa471096ddd2a4a024b139)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:19.784712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31d288-c687-4502-9543-53cc733b3be1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:19.786967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 93/190] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:19 2022] GET /identity/v3/projects/08afa27218fa471096ddd2a4a024b139 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:19.788168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483f17-ad21-4ceb-9a82-3a25f3e01ec0 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.788927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483f17-ad21-4ceb-9a82-3a25f3e01ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.788927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483f17-ad21-4ceb-9a82-3a25f3e01ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.805169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-20483f17-ad21-4ceb-9a82-3a25f3e01ec0 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:19.806369 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-20483f17-ad21-4ceb-9a82-3a25f3e01ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:19.817919 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62684ae-a022-459a-8b03-9c643bf1aee6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:19.850624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f28fe8-08b0-4f27-b4df-d13c1f02fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:19.851290 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28fe8-08b0-4f27-b4df-d13c1f02fbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.851573 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28fe8-08b0-4f27-b4df-d13c1f02fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.851858 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f28fe8-08b0-4f27-b4df-d13c1f02fbe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.852592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f28fe8-08b0-4f27-b4df-d13c1f02fbe8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:19.852918 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f28fe8-08b0-4f27-b4df-d13c1f02fbe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:19.854305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f28fe8-08b0-4f27-b4df-d13c1f02fbe8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:19.862102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 98/191] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:19.862937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f28fe8-08b0-4f27-b4df-d13c1f02fbe8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:19.874090 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 94/192] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:19.875370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20483f17-ad21-4ceb-9a82-3a25f3e01ec0 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:19.908582 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:19.935554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:19.962303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f28fe8-08b0-4f27-b4df-d13c1f02fbe8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:19.987701 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20483f17-ad21-4ceb-9a82-3a25f3e01ec0 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:19.995099 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1267db-b46a-4fac-8112-2e30a482741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:19.995775 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1267db-b46a-4fac-8112-2e30a482741b None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:19.996062 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1267db-b46a-4fac-8112-2e30a482741b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:19.996343 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1267db-b46a-4fac-8112-2e30a482741b None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:19.997093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1267db-b46a-4fac-8112-2e30a482741b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:19.998547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1267db-b46a-4fac-8112-2e30a482741b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:20.017988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 99/193] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:01:19 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:20.017988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1267db-b46a-4fac-8112-2e30a482741b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:20.031300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fe600-1c36-473d-a4a2-aa85a051fcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:20.032308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fe600-1c36-473d-a4a2-aa85a051fcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:20.032664 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fe600-1c36-473d-a4a2-aa85a051fcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:20.033048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fe600-1c36-473d-a4a2-aa85a051fcd7 None admin] PATH_INFO: `/v3/users/ca7ca679dd4c4f4bbee3a16217050f06` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:20.050052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fe600-1c36-473d-a4a2-aa85a051fcd7 None admin] RBAC: Authorizing `identity:get_user(user_id=ca7ca679dd4c4f4bbee3a16217050f06)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:20.052226 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fe600-1c36-473d-a4a2-aa85a051fcd7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:20.058694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 95/194] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:19 2022] GET /identity/v3/users/ca7ca679dd4c4f4bbee3a16217050f06 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:20.058694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fe600-1c36-473d-a4a2-aa85a051fcd7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:20.151092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1267db-b46a-4fac-8112-2e30a482741b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:20.152764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:20.183164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fe600-1c36-473d-a4a2-aa85a051fcd7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:20.191339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f7faf-9631-4804-b72e-c46773bdad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:20.192010 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f7faf-9631-4804-b72e-c46773bdad2f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:20.192389 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f7faf-9631-4804-b72e-c46773bdad2f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:20.193256 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:20.193373 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f7faf-9631-4804-b72e-c46773bdad2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:20.194206 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f7faf-9631-4804-b72e-c46773bdad2f None admin] RBAC: Adding query filter params (role.id=14df33950256418dae713180ece879af, scope.project.id=08afa27218fa471096ddd2a4a024b139, user.id=fdbc028fc50242ca95b20286bf2d6e57) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:20.195250 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f7faf-9631-4804-b72e-c46773bdad2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:20.196112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f7faf-9631-4804-b72e-c46773bdad2f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:20.203427 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 100/195] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:20 2022] GET /identity/v3/role_assignments?user.id=fdbc028fc50242ca95b20286bf2d6e57&scope.project.id=08afa27218fa471096ddd2a4a024b139&role.id=14df33950256418dae713180ece879af => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:20.204100 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f7faf-9631-4804-b72e-c46773bdad2f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:20.226372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f6db-b1d4-4e1c-bbb9-8960c376a1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:20.226556 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f6db-b1d4-4e1c-bbb9-8960c376a1fd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:20.226765 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f6db-b1d4-4e1c-bbb9-8960c376a1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:20.226983 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f6db-b1d4-4e1c-bbb9-8960c376a1fd None admin] PATH_INFO: `/v3/users/ca7ca679dd4c4f4bbee3a16217050f06` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:20.229515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668f6db-b1d4-4e1c-bbb9-8960c376a1fd None admin] RBAC: Authorizing `identity:get_user(user_id=ca7ca679dd4c4f4bbee3a16217050f06)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:20.231036 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668f6db-b1d4-4e1c-bbb9-8960c376a1fd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:20.233030 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 96/196] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:20 2022] GET /identity/v3/users/ca7ca679dd4c4f4bbee3a16217050f06 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:20.234663 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f6db-b1d4-4e1c-bbb9-8960c376a1fd None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:20.356266 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f7faf-9631-4804-b72e-c46773bdad2f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:20.394368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f6db-b1d4-4e1c-bbb9-8960c376a1fd None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:20.402288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3ffd-2507-42a1-87bb-70562851a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:20.403105 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3ffd-2507-42a1-87bb-70562851a002 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:20.403394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3ffd-2507-42a1-87bb-70562851a002 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:20.403675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3ffd-2507-42a1-87bb-70562851a002 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:20.418445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f3ffd-2507-42a1-87bb-70562851a002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-8c4f3ffd-2507-42a1-87bb-70562851a002 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:20.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:20.429137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:20.429925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:20.432386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 101/197] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:20.437001 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3ffd-2507-42a1-87bb-70562851a002 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:20.449765 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca60c-e442-427b-80e8-1303b1c6b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:20.450693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca60c-e442-427b-80e8-1303b1c6b9bb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:20.451156 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca60c-e442-427b-80e8-1303b1c6b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:20.451626 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca60c-e442-427b-80e8-1303b1c6b9bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:20.466145 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:20.506023 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:20.542227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aca60c-e442-427b-80e8-1303b1c6b9bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:20.544848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aca60c-e442-427b-80e8-1303b1c6b9bb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:20.561918 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3ffd-2507-42a1-87bb-70562851a002 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:20.606627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae0abb-c0c4-4dc9-9f17-3c3302e364f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:20.607375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0abb-c0c4-4dc9-9f17-3c3302e364f5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:20.607734 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0abb-c0c4-4dc9-9f17-3c3302e364f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:20.608091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0abb-c0c4-4dc9-9f17-3c3302e364f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:20.683499 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 97/198] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:20.685100 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca60c-e442-427b-80e8-1303b1c6b9bb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:20.685383 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae0abb-c0c4-4dc9-9f17-3c3302e364f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:20.687013 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae0abb-c0c4-4dc9-9f17-3c3302e364f5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:20.715661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:20.757453 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:20.791644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca60c-e442-427b-80e8-1303b1c6b9bb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:20.804769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 102/199] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:20.805568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae0abb-c0c4-4dc9-9f17-3c3302e364f5 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:20.834571 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f800e-8a92-4a0e-911c-5d0392fa58e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:20.835250 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f800e-8a92-4a0e-911c-5d0392fa58e8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:20.835538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f800e-8a92-4a0e-911c-5d0392fa58e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:20.835818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f800e-8a92-4a0e-911c-5d0392fa58e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:20.836576 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f800e-8a92-4a0e-911c-5d0392fa58e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:20.836886 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f800e-8a92-4a0e-911c-5d0392fa58e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:20.838318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f800e-8a92-4a0e-911c-5d0392fa58e8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:20.846856 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 98/200] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:20.847662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f800e-8a92-4a0e-911c-5d0392fa58e8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:20.925537 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae0abb-c0c4-4dc9-9f17-3c3302e364f5 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:20.960417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:20.972560 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f800e-8a92-4a0e-911c-5d0392fa58e8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:20.977566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed781653-551c-4051-9c9a-db2ce2166bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:20.978715 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed781653-551c-4051-9c9a-db2ce2166bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:20.979205 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed781653-551c-4051-9c9a-db2ce2166bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:20.979785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed781653-551c-4051-9c9a-db2ce2166bb1 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:20.981787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed781653-551c-4051-9c9a-db2ce2166bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:20.984364 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed781653-551c-4051-9c9a-db2ce2166bb1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:20.986889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 103/201] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:20 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:20.988363 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed781653-551c-4051-9c9a-db2ce2166bb1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:21.011462 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9871c-0c10-40ea-bf63-abe97c09353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:21.012015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9871c-0c10-40ea-bf63-abe97c09353d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:21.012302 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9871c-0c10-40ea-bf63-abe97c09353d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:21.012635 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9871c-0c10-40ea-bf63-abe97c09353d None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:21.013913 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9871c-0c10-40ea-bf63-abe97c09353d None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:21.015376 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9871c-0c10-40ea-bf63-abe97c09353d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:21.017124 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 99/202] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:20 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:21.022548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9871c-0c10-40ea-bf63-abe97c09353d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:21.025048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:21.124905 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed781653-551c-4051-9c9a-db2ce2166bb1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:21.144572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9871c-0c10-40ea-bf63-abe97c09353d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:21.160014 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1657b-ed44-495d-96aa-7d655ddb73b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:21.160914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1657b-ed44-495d-96aa-7d655ddb73b9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:21.161729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1657b-ed44-495d-96aa-7d655ddb73b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:21.162181 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1657b-ed44-495d-96aa-7d655ddb73b9 None admin] PATH_INFO: `/v3/users/2e6dbcd5bea34072844b4fcf82ef2577` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:21.163389 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1657b-ed44-495d-96aa-7d655ddb73b9 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6dbcd5bea34072844b4fcf82ef2577)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:21.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1657b-ed44-495d-96aa-7d655ddb73b9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:21.171412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 104/203] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:20 2022] GET /identity/v3/users/2e6dbcd5bea34072844b4fcf82ef2577 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:21.172243 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1657b-ed44-495d-96aa-7d655ddb73b9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:21.189945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007a254-3de5-4fd4-b781-7d3066343820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:21.190975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007a254-3de5-4fd4-b781-7d3066343820 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:21.191693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007a254-3de5-4fd4-b781-7d3066343820 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:21.192155 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007a254-3de5-4fd4-b781-7d3066343820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:21.193608 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007a254-3de5-4fd4-b781-7d3066343820 None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c, user.id=ca7ca679dd4c4f4bbee3a16217050f06) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:21.194107 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007a254-3de5-4fd4-b781-7d3066343820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:21.196282 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007a254-3de5-4fd4-b781-7d3066343820 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:21.204280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 100/204] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:21 2022] GET /identity/v3/role_assignments?user.id=ca7ca679dd4c4f4bbee3a16217050f06&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:21.205282 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007a254-3de5-4fd4-b781-7d3066343820 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:21.263505 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:21.292699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:21.336093 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007a254-3de5-4fd4-b781-7d3066343820 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:21.377054 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63a054-d907-4c28-8f6a-ee4855ed1b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:21.377983 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a054-d907-4c28-8f6a-ee4855ed1b9d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:21.378348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a054-d907-4c28-8f6a-ee4855ed1b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:21.378709 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a054-d907-4c28-8f6a-ee4855ed1b9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:21.394937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1657b-ed44-495d-96aa-7d655ddb73b9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:21.457184 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6530fc9-e55a-4fc3-a435-c4f3f0c04cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:21.458475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6530fc9-e55a-4fc3-a435-c4f3f0c04cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:21.459408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6530fc9-e55a-4fc3-a435-c4f3f0c04cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:21.459912 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6530fc9-e55a-4fc3-a435-c4f3f0c04cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:21.461905 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6530fc9-e55a-4fc3-a435-c4f3f0c04cd1 None admin] RBAC: Adding query filter params (role.id=a11101f17a5c44e5b5454f2f8af57cf3, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c, user.id=ca7ca679dd4c4f4bbee3a16217050f06) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:21.462344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6530fc9-e55a-4fc3-a435-c4f3f0c04cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:21.463998 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6530fc9-e55a-4fc3-a435-c4f3f0c04cd1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:21.471830 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63a054-d907-4c28-8f6a-ee4855ed1b9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:21.473405 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63a054-d907-4c28-8f6a-ee4855ed1b9d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:21.485423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 105/205] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:21 2022] GET /identity/v3/role_assignments?user.id=ca7ca679dd4c4f4bbee3a16217050f06&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=a11101f17a5c44e5b5454f2f8af57cf3 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:21.588767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:21.647475 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 101/206] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:21.653345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6530fc9-e55a-4fc3-a435-c4f3f0c04cd1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:21.775225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6530fc9-e55a-4fc3-a435-c4f3f0c04cd1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:21.804904 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:21.821617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187b6ec-27bd-4270-91de-deaf1b9c2309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:21.822570 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187b6ec-27bd-4270-91de-deaf1b9c2309 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:21.822859 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187b6ec-27bd-4270-91de-deaf1b9c2309 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:21.823140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187b6ec-27bd-4270-91de-deaf1b9c2309 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:21.824450 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187b6ec-27bd-4270-91de-deaf1b9c2309 None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:21.825951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187b6ec-27bd-4270-91de-deaf1b9c2309 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:21.827855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 106/207] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:21 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:21.834276 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63a054-d907-4c28-8f6a-ee4855ed1b9d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:21.945405 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63a054-d907-4c28-8f6a-ee4855ed1b9d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:21.994573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b01ced-eaeb-468c-9f15-3a7793e8c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:21.995256 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01ced-eaeb-468c-9f15-3a7793e8c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:21.995546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01ced-eaeb-468c-9f15-3a7793e8c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:21.995829 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01ced-eaeb-468c-9f15-3a7793e8c0e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:21.996674 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b01ced-eaeb-468c-9f15-3a7793e8c0e2 None admin] RBAC: Adding query filter params (role.id=5070a00cc59d4fb184e8235488c81f16, scope.project.id=6055d4c138374609abba19bcdd29bb97, user.id=2e6dbcd5bea34072844b4fcf82ef2577) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:21.997018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b01ced-eaeb-468c-9f15-3a7793e8c0e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:21.998610 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b01ced-eaeb-468c-9f15-3a7793e8c0e2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:22.006278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 102/208] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:21 2022] GET /identity/v3/role_assignments?user.id=2e6dbcd5bea34072844b4fcf82ef2577&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=5070a00cc59d4fb184e8235488c81f16 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:22.402775 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93615-efe1-44a2-b48b-2da87240c3a4 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:22.403272 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93615-efe1-44a2-b48b-2da87240c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:22.403693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93615-efe1-44a2-b48b-2da87240c3a4 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:22.405267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 107/209] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:22.410422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316a495-9520-4331-b7d7-716970186a6a None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:22.410828 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316a495-9520-4331-b7d7-716970186a6a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:22.411248 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316a495-9520-4331-b7d7-716970186a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:22.428870 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d316a495-9520-4331-b7d7-716970186a6a None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:22.430102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d316a495-9520-4331-b7d7-716970186a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:22.460065 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:22.508972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 103/210] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:22.532938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93615-efe1-44a2-b48b-2da87240c3a4 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:22.553665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca1ad3-f848-4d41-a945-55049edbb713 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:22.553882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca1ad3-f848-4d41-a945-55049edbb713 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:22.554154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca1ad3-f848-4d41-a945-55049edbb713 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:22.555694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 104/211] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:22.561054 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9930-e478-4f12-85a1-d8aabc6d5882 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:22.561343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9930-e478-4f12-85a1-d8aabc6d5882 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:22.561621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9930-e478-4f12-85a1-d8aabc6d5882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:22.579217 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a68e9930-e478-4f12-85a1-d8aabc6d5882 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:22.583125 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a68e9930-e478-4f12-85a1-d8aabc6d5882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:22.654641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 105/212] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:22.660553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93615-efe1-44a2-b48b-2da87240c3a4 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:22.680224 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e9930-e478-4f12-85a1-d8aabc6d5882 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:22.697790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43785a9f-e340-4c5e-afbf-6570f7459987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:22.698685 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43785a9f-e340-4c5e-afbf-6570f7459987 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:22.698975 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43785a9f-e340-4c5e-afbf-6570f7459987 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:22.699251 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43785a9f-e340-4c5e-afbf-6570f7459987 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:22.710383 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43785a9f-e340-4c5e-afbf-6570f7459987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-43785a9f-e340-4c5e-afbf-6570f7459987 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:22.718644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:22.719661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:22.720596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:22.722587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 108/213] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:22.734130 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43785a9f-e340-4c5e-afbf-6570f7459987 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:22.778496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:22.790581 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e9930-e478-4f12-85a1-d8aabc6d5882 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:22.849441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:22.861774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43785a9f-e340-4c5e-afbf-6570f7459987 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:22.895040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349f42b-a092-4053-ae56-11cfb12c1685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:22.896231 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f42b-a092-4053-ae56-11cfb12c1685 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:22.896721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f42b-a092-4053-ae56-11cfb12c1685 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:22.897220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f42b-a092-4053-ae56-11cfb12c1685 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:22.899319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349f42b-a092-4053-ae56-11cfb12c1685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:22.902717 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349f42b-a092-4053-ae56-11cfb12c1685 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:22.905003 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 106/214] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:22.914056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349f42b-a092-4053-ae56-11cfb12c1685 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:22.932920 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4cd0d-6f72-432e-8e90-54a78272047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:22.932920 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4cd0d-6f72-432e-8e90-54a78272047f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:22.932920 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4cd0d-6f72-432e-8e90-54a78272047f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:22.932920 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4cd0d-6f72-432e-8e90-54a78272047f None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:22.933348 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4cd0d-6f72-432e-8e90-54a78272047f None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:22.933348 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4cd0d-6f72-432e-8e90-54a78272047f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:22.934662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4cd0d-6f72-432e-8e90-54a78272047f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:22.947485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 109/215] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:22.958734 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4cd0d-6f72-432e-8e90-54a78272047f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:23.064187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349f42b-a092-4053-ae56-11cfb12c1685 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:23.102782 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38225a-3934-485c-a980-97260226cc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:23.103791 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38225a-3934-485c-a980-97260226cc8b None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:23.104411 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38225a-3934-485c-a980-97260226cc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:23.104944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38225a-3934-485c-a980-97260226cc8b None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:23.105932 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38225a-3934-485c-a980-97260226cc8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:23.107589 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38225a-3934-485c-a980-97260226cc8b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:23.142157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 107/216] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:01:22 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:23.155252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4cd0d-6f72-432e-8e90-54a78272047f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:23.179783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:23.203620 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e54d7-4421-4d7a-8528-c7d54b38b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:23.206412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e54d7-4421-4d7a-8528-c7d54b38b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:23.207392 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e54d7-4421-4d7a-8528-c7d54b38b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:23.208611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e54d7-4421-4d7a-8528-c7d54b38b0f3 None admin] PATH_INFO: `/v3/users/8a82617b6a1842dbb446e60c2ce0fc82` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:23.240209 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e54d7-4421-4d7a-8528-c7d54b38b0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=8a82617b6a1842dbb446e60c2ce0fc82)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:23.242748 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e54d7-4421-4d7a-8528-c7d54b38b0f3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:23.246888 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 110/217] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:22 2022] GET /identity/v3/users/8a82617b6a1842dbb446e60c2ce0fc82 => generated 297 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:23.253417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38225a-3934-485c-a980-97260226cc8b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:23.301289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:23.412110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38225a-3934-485c-a980-97260226cc8b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:23.452448 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4c1c0-83aa-4d7d-b817-91127ad029f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:23.453603 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4c1c0-83aa-4d7d-b817-91127ad029f0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:23.454112 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4c1c0-83aa-4d7d-b817-91127ad029f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:23.454658 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4c1c0-83aa-4d7d-b817-91127ad029f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:23.528313 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4c1c0-83aa-4d7d-b817-91127ad029f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:23.529843 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4c1c0-83aa-4d7d-b817-91127ad029f0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:23.545147 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:23.619812 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bff804-3224-484c-85a7-2f9885be5b61 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:23.620767 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bff804-3224-484c-85a7-2f9885be5b61 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:23.621267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bff804-3224-484c-85a7-2f9885be5b61 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:23.622888 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 111/218] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:23.628234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471c1d0-367e-47b4-aa99-c69d311706cc None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:23.628778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471c1d0-367e-47b4-aa99-c69d311706cc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:23.630305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471c1d0-367e-47b4-aa99-c69d311706cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:23.647136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 108/219] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:23.650224 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b471c1d0-367e-47b4-aa99-c69d311706cc None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:23.651503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b471c1d0-367e-47b4-aa99-c69d311706cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:23.652623 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4c1c0-83aa-4d7d-b817-91127ad029f0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:23.729813 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 112/220] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:23.752871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471c1d0-367e-47b4-aa99-c69d311706cc None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:23.769284 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4c1c0-83aa-4d7d-b817-91127ad029f0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:23.784602 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:23.813325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677be41-e6b6-4490-bd6f-82c918a5cd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:23.814457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677be41-e6b6-4490-bd6f-82c918a5cd10 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:23.814929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677be41-e6b6-4490-bd6f-82c918a5cd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:23.815411 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677be41-e6b6-4490-bd6f-82c918a5cd10 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:23.816802 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677be41-e6b6-4490-bd6f-82c918a5cd10 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:23.818558 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677be41-e6b6-4490-bd6f-82c918a5cd10 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:23.820772 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 109/221] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:23 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:23.826300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677be41-e6b6-4490-bd6f-82c918a5cd10 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:23.884061 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471c1d0-367e-47b4-aa99-c69d311706cc None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:23.888178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:23.925972 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f906c81-9290-486a-a8d7-9e27143b8804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:23.927221 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f906c81-9290-486a-a8d7-9e27143b8804 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:23.927714 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f906c81-9290-486a-a8d7-9e27143b8804 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:23.928248 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f906c81-9290-486a-a8d7-9e27143b8804 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:23.939272 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f906c81-9290-486a-a8d7-9e27143b8804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-9f906c81-9290-486a-a8d7-9e27143b8804 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:23.947638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:23.948538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:23.949394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:23.951827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 113/222] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:23.965915 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f906c81-9290-486a-a8d7-9e27143b8804 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:23.985101 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677be41-e6b6-4490-bd6f-82c918a5cd10 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:24.031381 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735d7fa-6496-403e-b67c-891e4a35a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:24.032089 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735d7fa-6496-403e-b67c-891e4a35a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:24.032336 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735d7fa-6496-403e-b67c-891e4a35a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:24.032608 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735d7fa-6496-403e-b67c-891e4a35a8e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:24.033935 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735d7fa-6496-403e-b67c-891e4a35a8e3 None admin] RBAC: Adding query filter params (role.id=14df33950256418dae713180ece879af, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c, user.id=8a82617b6a1842dbb446e60c2ce0fc82) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:24.034249 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735d7fa-6496-403e-b67c-891e4a35a8e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:24.037128 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735d7fa-6496-403e-b67c-891e4a35a8e3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:24.044458 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 110/223] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:23 2022] GET /identity/v3/role_assignments?user.id=8a82617b6a1842dbb446e60c2ce0fc82&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=14df33950256418dae713180ece879af => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:24.046238 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a564d21-a5de-4ef1-ae82-c51281841438 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:24.046805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a564d21-a5de-4ef1-ae82-c51281841438 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:24.047088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a564d21-a5de-4ef1-ae82-c51281841438 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:24.049577 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 111/224] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:24.056318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c0a5-2600-42ce-adb2-b0ace404e906 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:24.056615 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c0a5-2600-42ce-adb2-b0ace404e906 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:24.056875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c0a5-2600-42ce-adb2-b0ace404e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:24.082906 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-dc68c0a5-2600-42ce-adb2-b0ace404e906 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:24.087210 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-dc68c0a5-2600-42ce-adb2-b0ace404e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:24.135265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f906c81-9290-486a-a8d7-9e27143b8804 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:24.165749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:24.206466 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faeb63-e8e5-4695-a050-a3f0595fed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:24.207154 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faeb63-e8e5-4695-a050-a3f0595fed58 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:24.207437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faeb63-e8e5-4695-a050-a3f0595fed58 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:24.207714 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faeb63-e8e5-4695-a050-a3f0595fed58 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:24.209069 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faeb63-e8e5-4695-a050-a3f0595fed58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:24.209380 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faeb63-e8e5-4695-a050-a3f0595fed58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:24.210799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faeb63-e8e5-4695-a050-a3f0595fed58 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:24.218468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 112/225] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:24.226141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 114/226] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:24.227645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68c0a5-2600-42ce-adb2-b0ace404e906 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:24.247574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faeb63-e8e5-4695-a050-a3f0595fed58 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:24.278988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:24.383170 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faeb63-e8e5-4695-a050-a3f0595fed58 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:24.387491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68c0a5-2600-42ce-adb2-b0ace404e906 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:24.423381 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97238c34-31f0-491e-a9b3-8515f6dfdfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:24.424270 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97238c34-31f0-491e-a9b3-8515f6dfdfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:24.424555 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97238c34-31f0-491e-a9b3-8515f6dfdfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:24.424837 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97238c34-31f0-491e-a9b3-8515f6dfdfd2 None admin] PATH_INFO: `/v3/users/ca7ca679dd4c4f4bbee3a16217050f06` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:24.426154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97238c34-31f0-491e-a9b3-8515f6dfdfd2 None admin] RBAC: Authorizing `identity:get_user(user_id=ca7ca679dd4c4f4bbee3a16217050f06)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:24.428167 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97238c34-31f0-491e-a9b3-8515f6dfdfd2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:24.429852 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 113/227] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:24 2022] GET /identity/v3/users/ca7ca679dd4c4f4bbee3a16217050f06 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:24.437801 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97238c34-31f0-491e-a9b3-8515f6dfdfd2 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:24.459551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afaaa1-f079-494f-b8de-141ededd5d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:24.460375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afaaa1-f079-494f-b8de-141ededd5d71 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:24.460658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afaaa1-f079-494f-b8de-141ededd5d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:24.460958 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afaaa1-f079-494f-b8de-141ededd5d71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:24.476474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afaaa1-f079-494f-b8de-141ededd5d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d6afaaa1-f079-494f-b8de-141ededd5d71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:24.484480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:24.485408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:24.486192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:24.489699 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 115/228] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:24.495916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afaaa1-f079-494f-b8de-141ededd5d71 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:24.522266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:24.621267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:24.633807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afaaa1-f079-494f-b8de-141ededd5d71 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:24.663534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97238c34-31f0-491e-a9b3-8515f6dfdfd2 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:24.672770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbb2e0-c6fb-4b44-a010-8a15d3389ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:24.673484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb2e0-c6fb-4b44-a010-8a15d3389ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:24.673777 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb2e0-c6fb-4b44-a010-8a15d3389ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:24.674066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb2e0-c6fb-4b44-a010-8a15d3389ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:24.674824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbb2e0-c6fb-4b44-a010-8a15d3389ef4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:24.675139 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbb2e0-c6fb-4b44-a010-8a15d3389ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:24.676543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbb2e0-c6fb-4b44-a010-8a15d3389ef4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:24.686719 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 116/229] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:24.692878 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbb2e0-c6fb-4b44-a010-8a15d3389ef4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:24.793634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a2119-bdf5-44e8-ac40-05509dcdb3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:24.794700 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2119-bdf5-44e8-ac40-05509dcdb3bb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:24.794990 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2119-bdf5-44e8-ac40-05509dcdb3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:24.795271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2119-bdf5-44e8-ac40-05509dcdb3bb None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:24.800051 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbb2e0-c6fb-4b44-a010-8a15d3389ef4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:24.801673 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a2119-bdf5-44e8-ac40-05509dcdb3bb None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:24.803162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a2119-bdf5-44e8-ac40-05509dcdb3bb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:24.805232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 114/230] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:24 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:24.811451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a2119-bdf5-44e8-ac40-05509dcdb3bb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:24.837433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64cffe-1c68-440e-b2e1-a9100fdc541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:24.838911 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64cffe-1c68-440e-b2e1-a9100fdc541d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:24.839195 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64cffe-1c68-440e-b2e1-a9100fdc541d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:24.839473 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64cffe-1c68-440e-b2e1-a9100fdc541d None admin] PATH_INFO: `/v3/users/ca7ca679dd4c4f4bbee3a16217050f06` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:24.840741 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64cffe-1c68-440e-b2e1-a9100fdc541d None admin] RBAC: Authorizing `identity:get_user(user_id=ca7ca679dd4c4f4bbee3a16217050f06)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:24.842326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64cffe-1c68-440e-b2e1-a9100fdc541d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:24.844722 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 117/231] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:24 2022] GET /identity/v3/users/ca7ca679dd4c4f4bbee3a16217050f06 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:24.850369 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64cffe-1c68-440e-b2e1-a9100fdc541d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:24.881313 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:24.961472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64cffe-1c68-440e-b2e1-a9100fdc541d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:24.999437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ee97a-804a-4a44-97bb-4e62553a1b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:25.000327 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ee97a-804a-4a44-97bb-4e62553a1b5a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:25.000612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ee97a-804a-4a44-97bb-4e62553a1b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:25.000914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ee97a-804a-4a44-97bb-4e62553a1b5a None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:25.002503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ee97a-804a-4a44-97bb-4e62553a1b5a None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:25.004447 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ee97a-804a-4a44-97bb-4e62553a1b5a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:25.007016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 118/232] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:24 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:25.012526 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ee97a-804a-4a44-97bb-4e62553a1b5a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:25.108178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a2119-bdf5-44e8-ac40-05509dcdb3bb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:25.116128 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:25.134458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ee97a-804a-4a44-97bb-4e62553a1b5a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:25.161767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:25.172478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2e552-d36e-4d62-b23e-b90ad30f788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:25.173419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e552-d36e-4d62-b23e-b90ad30f788d None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:25.173790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e552-d36e-4d62-b23e-b90ad30f788d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:25.174223 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2e552-d36e-4d62-b23e-b90ad30f788d None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/users/ca7ca679dd4c4f4bbee3a16217050f06/roles/a11101f17a5c44e5b5454f2f8af57cf3` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:25.177519 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2e552-d36e-4d62-b23e-b90ad30f788d None admin] RBAC: Authorizing `identity:create_grant(project_id=575de2d42ac04a449b44cc054a2e5b2c, user_id=ca7ca679dd4c4f4bbee3a16217050f06, role_id=a11101f17a5c44e5b5454f2f8af57cf3)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:25.179282 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2e552-d36e-4d62-b23e-b90ad30f788d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:25.197585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 119/233] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:01:25 2022] PUT /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/users/ca7ca679dd4c4f4bbee3a16217050f06/roles/a11101f17a5c44e5b5454f2f8af57cf3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:25.219480 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b99d1-71e7-48bf-96d0-b112a815c770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:25.220796 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b99d1-71e7-48bf-96d0-b112a815c770 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:25.221308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b99d1-71e7-48bf-96d0-b112a815c770 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:25.221780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b99d1-71e7-48bf-96d0-b112a815c770 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/users/ca7ca679dd4c4f4bbee3a16217050f06/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:25.228495 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b99d1-71e7-48bf-96d0-b112a815c770 None admin] RBAC: Authorizing `identity:create_grant(project_id=575de2d42ac04a449b44cc054a2e5b2c, user_id=ca7ca679dd4c4f4bbee3a16217050f06, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:25.230395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b99d1-71e7-48bf-96d0-b112a815c770 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:25.261361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 115/234] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:01:24 2022] PUT /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/users/ca7ca679dd4c4f4bbee3a16217050f06/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:25.926421 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7a2-8266-47a2-8317-fd197f22a544 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:25.927486 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7a2-8266-47a2-8317-fd197f22a544 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:25.927562 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7a2-8266-47a2-8317-fd197f22a544 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:25.929186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 120/235] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:25.934334 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdd806-23d8-467f-ad1d-4c541dfcb6ce None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:25.935186 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdd806-23d8-467f-ad1d-4c541dfcb6ce None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:25.935693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdd806-23d8-467f-ad1d-4c541dfcb6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:25.953642 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d0bdd806-23d8-467f-ad1d-4c541dfcb6ce None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:25.955168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d0bdd806-23d8-467f-ad1d-4c541dfcb6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:26.026882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 116/236] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:26.051050 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b7a2-8266-47a2-8317-fd197f22a544 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:26.160317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaac79-b00a-4f55-8366-d8cc34d43211 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:26.161058 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaac79-b00a-4f55-8366-d8cc34d43211 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:26.162038 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaac79-b00a-4f55-8366-d8cc34d43211 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:26.163903 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 117/237] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:26.169114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64a5ef-176c-46e9-8db0-8564ca3b2dfa None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:26.169644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64a5ef-176c-46e9-8db0-8564ca3b2dfa None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:26.170124 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64a5ef-176c-46e9-8db0-8564ca3b2dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:26.189000 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0c64a5ef-176c-46e9-8db0-8564ca3b2dfa None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:26.190506 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b7a2-8266-47a2-8317-fd197f22a544 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:26.190804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0c64a5ef-176c-46e9-8db0-8564ca3b2dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:26.252774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333ae5e-e78a-47e9-938b-c4e1606f96eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:26.254313 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ae5e-e78a-47e9-938b-c4e1606f96eb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:26.255640 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ae5e-e78a-47e9-938b-c4e1606f96eb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:26.260343 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ae5e-e78a-47e9-938b-c4e1606f96eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:26.278375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333ae5e-e78a-47e9-938b-c4e1606f96eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-b333ae5e-e78a-47e9-938b-c4e1606f96eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:26.287542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:26.288423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:26.289241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:26.291971 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 121/238] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:26.298799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333ae5e-e78a-47e9-938b-c4e1606f96eb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:26.325702 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:26.333703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 118/239] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:26.405688 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64a5ef-176c-46e9-8db0-8564ca3b2dfa None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:26.439768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333ae5e-e78a-47e9-938b-c4e1606f96eb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:26.457633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:26.476360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db0d10-52d8-44ce-b205-83c2a7d987e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:26.477342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db0d10-52d8-44ce-b205-83c2a7d987e7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:26.477767 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db0d10-52d8-44ce-b205-83c2a7d987e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:26.478233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db0d10-52d8-44ce-b205-83c2a7d987e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:26.479122 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db0d10-52d8-44ce-b205-83c2a7d987e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:26.479596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db0d10-52d8-44ce-b205-83c2a7d987e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:26.481162 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db0d10-52d8-44ce-b205-83c2a7d987e7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:26.490674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 122/240] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:26.492140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959341a-859e-494c-9c5d-3d39c40eccdd None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:26.492569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959341a-859e-494c-9c5d-3d39c40eccdd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:26.493013 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959341a-859e-494c-9c5d-3d39c40eccdd None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:26.494384 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 123/241] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:26.496850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959341a-859e-494c-9c5d-3d39c40eccdd None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:26.554421 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64a5ef-176c-46e9-8db0-8564ca3b2dfa None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:26.580612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:26.592510 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3d6f9-3544-4bda-beba-a0525cf8e39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:26.593634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3d6f9-3544-4bda-beba-a0525cf8e39a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:26.594092 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3d6f9-3544-4bda-beba-a0525cf8e39a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:26.594520 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3d6f9-3544-4bda-beba-a0525cf8e39a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:26.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3d6f9-3544-4bda-beba-a0525cf8e39a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:26.597726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3d6f9-3544-4bda-beba-a0525cf8e39a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:26.600057 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 119/242] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:26.601664 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7423c-017a-494b-8e99-00e57acd0a6d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:26.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7423c-017a-494b-8e99-00e57acd0a6d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:26.602595 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7423c-017a-494b-8e99-00e57acd0a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:26.620744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0ec7423c-017a-494b-8e99-00e57acd0a6d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:26.621436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959341a-859e-494c-9c5d-3d39c40eccdd None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:26.622433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0ec7423c-017a-494b-8e99-00e57acd0a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:26.666530 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d87dc5-a03a-41e8-aa42-d1a89c5ff492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:26.667691 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d87dc5-a03a-41e8-aa42-d1a89c5ff492 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:26.668129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d87dc5-a03a-41e8-aa42-d1a89c5ff492 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:26.668550 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d87dc5-a03a-41e8-aa42-d1a89c5ff492 None admin] PATH_INFO: `/v3/users/b756835b1a8a4185b3c5d6242edab875` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:26.688927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d87dc5-a03a-41e8-aa42-d1a89c5ff492 None admin] RBAC: Authorizing `identity:get_user(user_id=b756835b1a8a4185b3c5d6242edab875)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:26.691147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d87dc5-a03a-41e8-aa42-d1a89c5ff492 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:26.697986 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 124/243] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:26 2022] GET /identity/v3/users/b756835b1a8a4185b3c5d6242edab875 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:26.697986 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d87dc5-a03a-41e8-aa42-d1a89c5ff492 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:26.713830 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 120/244] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:26.722028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7423c-017a-494b-8e99-00e57acd0a6d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:26.768162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:26.830793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d87dc5-a03a-41e8-aa42-d1a89c5ff492 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:26.850662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7423c-017a-494b-8e99-00e57acd0a6d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:26.858221 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:26.871540 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00a96c-15a7-40c0-9c33-93c4a450b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:26.872515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00a96c-15a7-40c0-9c33-93c4a450b34b None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:26.873037 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00a96c-15a7-40c0-9c33-93c4a450b34b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:26.873516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00a96c-15a7-40c0-9c33-93c4a450b34b None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:26.874495 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00a96c-15a7-40c0-9c33-93c4a450b34b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:26.876193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00a96c-15a7-40c0-9c33-93c4a450b34b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:26.894588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64897cd6-d204-4534-8a23-05db5ea5b81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:26.895821 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897cd6-d204-4534-8a23-05db5ea5b81c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:26.896144 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897cd6-d204-4534-8a23-05db5ea5b81c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:26.896429 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897cd6-d204-4534-8a23-05db5ea5b81c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:26.900788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 125/245] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:01:26 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:26.901864 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00a96c-15a7-40c0-9c33-93c4a450b34b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:26.991840 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64897cd6-d204-4534-8a23-05db5ea5b81c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:26.994197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64897cd6-d204-4534-8a23-05db5ea5b81c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:27.027879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00a96c-15a7-40c0-9c33-93c4a450b34b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:27.042279 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:27.071625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae581b-97e8-4504-a71d-abf295165dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:27.072774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae581b-97e8-4504-a71d-abf295165dcd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:27.072887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae581b-97e8-4504-a71d-abf295165dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:27.073150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae581b-97e8-4504-a71d-abf295165dcd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:27.085827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae581b-97e8-4504-a71d-abf295165dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-29ae581b-97e8-4504-a71d-abf295165dcd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:27.094587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:27.095476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:27.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 126/246] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:27.105088 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae581b-97e8-4504-a71d-abf295165dcd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:27.144003 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 121/247] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:27.159652 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64897cd6-d204-4534-8a23-05db5ea5b81c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:27.180334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:27.250976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae581b-97e8-4504-a71d-abf295165dcd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:27.288100 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbd5eb-d032-48ca-84a6-aa979530ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:27.289054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbd5eb-d032-48ca-84a6-aa979530ed05 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:27.289489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbd5eb-d032-48ca-84a6-aa979530ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:27.289943 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbd5eb-d032-48ca-84a6-aa979530ed05 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:27.290954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbd5eb-d032-48ca-84a6-aa979530ed05 None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:27.291410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbd5eb-d032-48ca-84a6-aa979530ed05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:27.293296 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbd5eb-d032-48ca-84a6-aa979530ed05 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:27.300282 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64897cd6-d204-4534-8a23-05db5ea5b81c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:27.309982 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 127/248] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:27.311274 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbd5eb-d032-48ca-84a6-aa979530ed05 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:27.333345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:27.340357 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65f0c3-1752-477f-9ff6-f29cbdc48b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:27.341893 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65f0c3-1752-477f-9ff6-f29cbdc48b62 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:27.342419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65f0c3-1752-477f-9ff6-f29cbdc48b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:27.343144 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65f0c3-1752-477f-9ff6-f29cbdc48b62 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:27.344946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65f0c3-1752-477f-9ff6-f29cbdc48b62 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:27.347358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65f0c3-1752-477f-9ff6-f29cbdc48b62 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:27.355474 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 122/249] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:27 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:27.356880 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65f0c3-1752-477f-9ff6-f29cbdc48b62 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:27.452573 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbd5eb-d032-48ca-84a6-aa979530ed05 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:27.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:27.476974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65f0c3-1752-477f-9ff6-f29cbdc48b62 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:27.498413 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10048f-6bea-4539-bff7-758bec0b1081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:27.499562 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10048f-6bea-4539-bff7-758bec0b1081 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:27.499852 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10048f-6bea-4539-bff7-758bec0b1081 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:27.500136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10048f-6bea-4539-bff7-758bec0b1081 None admin] PATH_INFO: `/v3/users/8a82617b6a1842dbb446e60c2ce0fc82` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:27.503869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10048f-6bea-4539-bff7-758bec0b1081 None admin] RBAC: Authorizing `identity:get_user(user_id=8a82617b6a1842dbb446e60c2ce0fc82)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:27.506564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10048f-6bea-4539-bff7-758bec0b1081 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:27.512938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 128/250] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:27 2022] GET /identity/v3/users/8a82617b6a1842dbb446e60c2ce0fc82 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:27.514464 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10048f-6bea-4539-bff7-758bec0b1081 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:27.527079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afb044-33fd-4c9b-9824-1140fb116118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:27.528182 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afb044-33fd-4c9b-9824-1140fb116118 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:27.528709 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afb044-33fd-4c9b-9824-1140fb116118 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:27.529318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afb044-33fd-4c9b-9824-1140fb116118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:27.530367 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afb044-33fd-4c9b-9824-1140fb116118 None admin] RBAC: Adding query filter params (role.id=5070a00cc59d4fb184e8235488c81f16, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c, user.id=b756835b1a8a4185b3c5d6242edab875) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:27.530901 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afb044-33fd-4c9b-9824-1140fb116118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:27.532760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afb044-33fd-4c9b-9824-1140fb116118 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:27.542901 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 123/251] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:27 2022] GET /identity/v3/role_assignments?user.id=b756835b1a8a4185b3c5d6242edab875&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=5070a00cc59d4fb184e8235488c81f16 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:27.628186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10048f-6bea-4539-bff7-758bec0b1081 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:27.652733 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d7716-b509-422b-a962-ce92465da99d None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:27.653080 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d7716-b509-422b-a962-ce92465da99d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:27.653352 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d7716-b509-422b-a962-ce92465da99d None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:27.658210 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 124/252] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:27.661489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d519a-6e7b-4380-bafc-a42d4d74dcc1 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:27.661779 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d519a-6e7b-4380-bafc-a42d4d74dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:27.662060 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d519a-6e7b-4380-bafc-a42d4d74dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:27.666005 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97cea3-39c6-4e1d-aba4-682bf3790172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:27.666955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97cea3-39c6-4e1d-aba4-682bf3790172 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:27.667248 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97cea3-39c6-4e1d-aba4-682bf3790172 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:27.667530 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97cea3-39c6-4e1d-aba4-682bf3790172 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:27.669053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97cea3-39c6-4e1d-aba4-682bf3790172 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:27.670549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97cea3-39c6-4e1d-aba4-682bf3790172 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:27.672652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 129/253] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:27 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:27.680053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97cea3-39c6-4e1d-aba4-682bf3790172 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:27.696168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a15d519a-6e7b-4380-bafc-a42d4d74dcc1 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:27.697488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a15d519a-6e7b-4380-bafc-a42d4d74dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:27.731740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:27.782603 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:27.799282 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 125/254] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:27.807763 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97cea3-39c6-4e1d-aba4-682bf3790172 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:27.824361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d519a-6e7b-4380-bafc-a42d4d74dcc1 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:27.851826 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c61a55-a738-4f85-b3b2-7da8a9c9515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:27.852735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61a55-a738-4f85-b3b2-7da8a9c9515a None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:27.853053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61a55-a738-4f85-b3b2-7da8a9c9515a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:27.853354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61a55-a738-4f85-b3b2-7da8a9c9515a None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/users/8a82617b6a1842dbb446e60c2ce0fc82/roles/14df33950256418dae713180ece879af` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:27.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c61a55-a738-4f85-b3b2-7da8a9c9515a None admin] RBAC: Authorizing `identity:create_grant(project_id=575de2d42ac04a449b44cc054a2e5b2c, user_id=8a82617b6a1842dbb446e60c2ce0fc82, role_id=14df33950256418dae713180ece879af)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:27.858469 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c61a55-a738-4f85-b3b2-7da8a9c9515a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:27.877673 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 130/255] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:01:27 2022] PUT /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/users/8a82617b6a1842dbb446e60c2ce0fc82/roles/14df33950256418dae713180ece879af => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 10:01:27.946155 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523509b-f8f6-4e56-b0d8-4d3bf626cfdc None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:27.946537 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523509b-f8f6-4e56-b0d8-4d3bf626cfdc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:27.946890 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523509b-f8f6-4e56-b0d8-4d3bf626cfdc None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:27.951319 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 131/256] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:27.956106 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a335d-6948-4cd8-b719-601f469a6480 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:27.956472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a335d-6948-4cd8-b719-601f469a6480 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:27.957392 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a335d-6948-4cd8-b719-601f469a6480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:27.978777 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-429a335d-6948-4cd8-b719-601f469a6480 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:27.979924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d519a-6e7b-4380-bafc-a42d4d74dcc1 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:27.980307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-429a335d-6948-4cd8-b719-601f469a6480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:28.072397 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd513-39f7-47c6-8534-cafe37bfc9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:28.073171 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd513-39f7-47c6-8534-cafe37bfc9aa None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:28.073456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd513-39f7-47c6-8534-cafe37bfc9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:28.073734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd513-39f7-47c6-8534-cafe37bfc9aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:28.084572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cd513-39f7-47c6-8534-cafe37bfc9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:28.088404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 132/257] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-9d7cd513-39f7-47c6-8534-cafe37bfc9aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:28.097395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:28.098341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:28.099683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 126/258] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:28.105799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a335d-6948-4cd8-b719-601f469a6480 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:28.120714 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd513-39f7-47c6-8534-cafe37bfc9aa None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:28.155457 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:28.180231 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:28.229244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd513-39f7-47c6-8534-cafe37bfc9aa None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:28.264429 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb57f1-6b6e-468f-acf2-5ff1b57fc9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:28.265260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb57f1-6b6e-468f-acf2-5ff1b57fc9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:28.265540 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb57f1-6b6e-468f-acf2-5ff1b57fc9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:28.265812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb57f1-6b6e-468f-acf2-5ff1b57fc9a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:28.273940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a335d-6948-4cd8-b719-601f469a6480 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:28.276798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb57f1-6b6e-468f-acf2-5ff1b57fc9a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-06eb57f1-6b6e-468f-acf2-5ff1b57fc9a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:28.284613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:28.285565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:28.286940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 127/259] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:28.292383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb57f1-6b6e-468f-acf2-5ff1b57fc9a8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:28.373704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bb834-9354-4e22-b4f1-73aabee7030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:28.374317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb834-9354-4e22-b4f1-73aabee7030a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:28.374605 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb834-9354-4e22-b4f1-73aabee7030a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:28.374891 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bb834-9354-4e22-b4f1-73aabee7030a None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:28.375657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bb834-9354-4e22-b4f1-73aabee7030a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:28.375972 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bb834-9354-4e22-b4f1-73aabee7030a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:28.377389 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bb834-9354-4e22-b4f1-73aabee7030a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:28.393588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 133/260] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:28.396551 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb57f1-6b6e-468f-acf2-5ff1b57fc9a8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:28.399750 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bb834-9354-4e22-b4f1-73aabee7030a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:28.429276 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:28.438725 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6f7ec-2f90-4b83-aaf3-fba0b12cc455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:28.441195 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f7ec-2f90-4b83-aaf3-fba0b12cc455 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:28.441195 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f7ec-2f90-4b83-aaf3-fba0b12cc455 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:28.441195 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f7ec-2f90-4b83-aaf3-fba0b12cc455 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:28.441195 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6f7ec-2f90-4b83-aaf3-fba0b12cc455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:28.441195 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6f7ec-2f90-4b83-aaf3-fba0b12cc455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:28.442672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6f7ec-2f90-4b83-aaf3-fba0b12cc455 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:28.470861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 128/261] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:28.477890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6f7ec-2f90-4b83-aaf3-fba0b12cc455 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:28.588965 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:28.600069 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bb834-9354-4e22-b4f1-73aabee7030a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:28.661991 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2c27b-2d9c-4dea-941d-ca92c8031a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:28.662792 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c27b-2d9c-4dea-941d-ca92c8031a6e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:28.663081 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c27b-2d9c-4dea-941d-ca92c8031a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:28.663357 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2c27b-2d9c-4dea-941d-ca92c8031a6e None admin] PATH_INFO: `/v3/users/ca7ca679dd4c4f4bbee3a16217050f06` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:28.665104 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2c27b-2d9c-4dea-941d-ca92c8031a6e None admin] RBAC: Authorizing `identity:get_user(user_id=ca7ca679dd4c4f4bbee3a16217050f06)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:28.666571 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2c27b-2d9c-4dea-941d-ca92c8031a6e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:28.670834 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6f7ec-2f90-4b83-aaf3-fba0b12cc455 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:28.672325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 134/262] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:28 2022] GET /identity/v3/users/ca7ca679dd4c4f4bbee3a16217050f06 => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:28.677529 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2c27b-2d9c-4dea-941d-ca92c8031a6e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:28.742283 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99598b0-dcc1-408b-b1eb-aa3dcd8e7b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:28.743168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99598b0-dcc1-408b-b1eb-aa3dcd8e7b29 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:28.743453 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99598b0-dcc1-408b-b1eb-aa3dcd8e7b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:28.743728 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99598b0-dcc1-408b-b1eb-aa3dcd8e7b29 None admin] PATH_INFO: `/v3/users/ca7ca679dd4c4f4bbee3a16217050f06` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:28.745532 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99598b0-dcc1-408b-b1eb-aa3dcd8e7b29 None admin] RBAC: Authorizing `identity:get_user(user_id=ca7ca679dd4c4f4bbee3a16217050f06)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:28.746996 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99598b0-dcc1-408b-b1eb-aa3dcd8e7b29 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:28.748655 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 129/263] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:28 2022] GET /identity/v3/users/ca7ca679dd4c4f4bbee3a16217050f06 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:28.755150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99598b0-dcc1-408b-b1eb-aa3dcd8e7b29 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:28.830060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2c27b-2d9c-4dea-941d-ca92c8031a6e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:28.835389 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:28.893907 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f9194-9f6c-4d41-9d04-c8259ac25ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:28.894569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9194-9f6c-4d41-9d04-c8259ac25ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:28.894856 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9194-9f6c-4d41-9d04-c8259ac25ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:28.895136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9194-9f6c-4d41-9d04-c8259ac25ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:28.944026 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99598b0-dcc1-408b-b1eb-aa3dcd8e7b29 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:28.957203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:28.978869 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748a890-c808-43ea-a814-419f4b36f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:28.979524 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a890-c808-43ea-a814-419f4b36f805 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:28.979810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a890-c808-43ea-a814-419f4b36f805 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:28.980089 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a890-c808-43ea-a814-419f4b36f805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:29.059054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f9194-9f6c-4d41-9d04-c8259ac25ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:29.060543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f9194-9f6c-4d41-9d04-c8259ac25ed6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:29.080748 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748a890-c808-43ea-a814-419f4b36f805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:29.082255 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748a890-c808-43ea-a814-419f4b36f805 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:29.164289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:29.233000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 135/264] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:29.236718 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f9194-9f6c-4d41-9d04-c8259ac25ed6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:29.274805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 130/265] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:29.282057 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748a890-c808-43ea-a814-419f4b36f805 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:29.354365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:29.407565 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f9194-9f6c-4d41-9d04-c8259ac25ed6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:29.466444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06ae62-5acc-4f44-a097-79a279a4cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:29.467322 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06ae62-5acc-4f44-a097-79a279a4cde8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:29.467604 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06ae62-5acc-4f44-a097-79a279a4cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:29.467880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06ae62-5acc-4f44-a097-79a279a4cde8 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:29.476913 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06ae62-5acc-4f44-a097-79a279a4cde8 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:29.476913 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06ae62-5acc-4f44-a097-79a279a4cde8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:29.477262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 136/266] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:29 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:29.483503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06ae62-5acc-4f44-a097-79a279a4cde8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:29.524667 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748a890-c808-43ea-a814-419f4b36f805 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:29.602931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f696ee-557f-4f5e-ac6c-a6e81b9395fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:29.604196 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f696ee-557f-4f5e-ac6c-a6e81b9395fa None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:29.604699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f696ee-557f-4f5e-ac6c-a6e81b9395fa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:29.605204 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f696ee-557f-4f5e-ac6c-a6e81b9395fa None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:29.613670 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f696ee-557f-4f5e-ac6c-a6e81b9395fa None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:29.615400 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f696ee-557f-4f5e-ac6c-a6e81b9395fa None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:29.617379 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 131/267] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:29 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:29.622963 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f696ee-557f-4f5e-ac6c-a6e81b9395fa None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:29.648915 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06ae62-5acc-4f44-a097-79a279a4cde8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:29.652579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:29.683742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:29.702079 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c912dab-b59c-4a3e-b527-05a788f4a40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:29.702744 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c912dab-b59c-4a3e-b527-05a788f4a40e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:29.703034 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c912dab-b59c-4a3e-b527-05a788f4a40e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:29.703314 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c912dab-b59c-4a3e-b527-05a788f4a40e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:29.704144 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c912dab-b59c-4a3e-b527-05a788f4a40e None admin] RBAC: Adding query filter params (role.id=a11101f17a5c44e5b5454f2f8af57cf3, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c, user.id=ca7ca679dd4c4f4bbee3a16217050f06) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:29.704458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c912dab-b59c-4a3e-b527-05a788f4a40e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:29.708912 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c912dab-b59c-4a3e-b527-05a788f4a40e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:29.712236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 137/268] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:29 2022] GET /identity/v3/role_assignments?user.id=ca7ca679dd4c4f4bbee3a16217050f06&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=a11101f17a5c44e5b5454f2f8af57cf3 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:29.813623 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f696ee-557f-4f5e-ac6c-a6e81b9395fa None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:29.865798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b0f66-7dde-4ce1-8ab0-a70067c36a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:29.866483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b0f66-7dde-4ce1-8ab0-a70067c36a0a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:29.866759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b0f66-7dde-4ce1-8ab0-a70067c36a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:29.867035 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b0f66-7dde-4ce1-8ab0-a70067c36a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:29.867886 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b0f66-7dde-4ce1-8ab0-a70067c36a0a None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c, user.id=ca7ca679dd4c4f4bbee3a16217050f06) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:29.868198 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b0f66-7dde-4ce1-8ab0-a70067c36a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:29.869689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b0f66-7dde-4ce1-8ab0-a70067c36a0a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:29.876430 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 132/269] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:29 2022] GET /identity/v3/role_assignments?user.id=ca7ca679dd4c4f4bbee3a16217050f06&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:30.506109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0498da-4868-48d4-a2b7-5e5e68f10142 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:30.506610 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0498da-4868-48d4-a2b7-5e5e68f10142 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:30.506713 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0498da-4868-48d4-a2b7-5e5e68f10142 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:30.508366 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 138/270] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:30.513704 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4765b8d-f86f-498c-8a5b-f2ed4a01558f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:30.514112 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4765b8d-f86f-498c-8a5b-f2ed4a01558f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:30.514281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4765b8d-f86f-498c-8a5b-f2ed4a01558f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:30.532813 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c4765b8d-f86f-498c-8a5b-f2ed4a01558f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:30.534043 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c4765b8d-f86f-498c-8a5b-f2ed4a01558f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:30.591173 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b409e4-142a-4047-b208-116abb68599f None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:30.591537 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b409e4-142a-4047-b208-116abb68599f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:30.591642 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b409e4-142a-4047-b208-116abb68599f None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:30.593356 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 139/271] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:30.598340 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f296-351e-4429-8fd2-c38ccfb278f3 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:30.599403 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f296-351e-4429-8fd2-c38ccfb278f3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:30.599862 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f296-351e-4429-8fd2-c38ccfb278f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:30.613532 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 133/272] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:30.618419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d798f296-351e-4429-8fd2-c38ccfb278f3 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:30.619822 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d798f296-351e-4429-8fd2-c38ccfb278f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:30.626624 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6971d-e678-4d08-a929-3c233fa718ed None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:30.626922 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6971d-e678-4d08-a929-3c233fa718ed None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:30.627212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6971d-e678-4d08-a929-3c233fa718ed None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:30.628714 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 134/273] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:30.633730 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceec93-d4dd-4981-9517-85f3ec1a67d6 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:30.634145 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceec93-d4dd-4981-9517-85f3ec1a67d6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:30.634502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceec93-d4dd-4981-9517-85f3ec1a67d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:30.641328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:30.654301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-39ceec93-d4dd-4981-9517-85f3ec1a67d6 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:30.655490 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-39ceec93-d4dd-4981-9517-85f3ec1a67d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:30.695869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 140/274] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:30.697059 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798f296-351e-4429-8fd2-c38ccfb278f3 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:30.732963 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 135/275] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:30.738333 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a77b58-f3c9-4545-9e51-bbbf62bf1b36 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:30.738631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a77b58-f3c9-4545-9e51-bbbf62bf1b36 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:30.738937 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a77b58-f3c9-4545-9e51-bbbf62bf1b36 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:30.741796 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 136/276] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:30.741796 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a77b58-f3c9-4545-9e51-bbbf62bf1b36 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:30.798730 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798f296-351e-4429-8fd2-c38ccfb278f3 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:30.818181 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:30.832514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e84a8-7e0a-4611-a925-4d24810f479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:30.833868 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e84a8-7e0a-4611-a925-4d24810f479a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:30.834150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e84a8-7e0a-4611-a925-4d24810f479a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:30.834425 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e84a8-7e0a-4611-a925-4d24810f479a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:30.835579 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e84a8-7e0a-4611-a925-4d24810f479a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:30.837070 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e84a8-7e0a-4611-a925-4d24810f479a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:30.838678 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 141/277] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:30.839789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d18d-ce17-4c6a-8f23-0bc4d25f6700 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:30.840077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d18d-ce17-4c6a-8f23-0bc4d25f6700 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:30.840349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d18d-ce17-4c6a-8f23-0bc4d25f6700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:30.846687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a77b58-f3c9-4545-9e51-bbbf62bf1b36 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:30.855875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1587d18d-ce17-4c6a-8f23-0bc4d25f6700 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:30.857109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1587d18d-ce17-4c6a-8f23-0bc4d25f6700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:30.880401 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403f28-8975-4d51-bf56-c098a5289f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:30.881225 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403f28-8975-4d51-bf56-c098a5289f4f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:30.881508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403f28-8975-4d51-bf56-c098a5289f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:30.881781 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403f28-8975-4d51-bf56-c098a5289f4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:30.883618 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:30.892412 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403f28-8975-4d51-bf56-c098a5289f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-64403f28-8975-4d51-bf56-c098a5289f4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:30.900726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:30.901721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:30.902484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 137/278] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:30.903119 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403f28-8975-4d51-bf56-c098a5289f4f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:30.924442 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 142/279] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:30.928134 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587d18d-ce17-4c6a-8f23-0bc4d25f6700 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:31.003554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403f28-8975-4d51-bf56-c098a5289f4f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:31.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587d18d-ce17-4c6a-8f23-0bc4d25f6700 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:31.036728 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66588e-4559-4759-962d-c87f4b6baaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:31.037565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66588e-4559-4759-962d-c87f4b6baaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:31.037848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66588e-4559-4759-962d-c87f4b6baaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:31.038127 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66588e-4559-4759-962d-c87f4b6baaf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:31.042733 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:31.048719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66588e-4559-4759-962d-c87f4b6baaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-bb66588e-4559-4759-962d-c87f4b6baaf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:31.056858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:31.057729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:31.058550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 138/280] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:31.059378 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66588e-4559-4759-962d-c87f4b6baaf2 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:31.063442 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23061da7-3e7f-4767-b5a6-adcb559b186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:31.064118 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23061da7-3e7f-4767-b5a6-adcb559b186a None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:31.064405 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23061da7-3e7f-4767-b5a6-adcb559b186a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:31.064681 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23061da7-3e7f-4767-b5a6-adcb559b186a None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:31.065417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23061da7-3e7f-4767-b5a6-adcb559b186a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:31.066863 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23061da7-3e7f-4767-b5a6-adcb559b186a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:31.087442 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 143/281] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:01:30 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:31.088253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23061da7-3e7f-4767-b5a6-adcb559b186a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:31.131212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:31.185266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66588e-4559-4759-962d-c87f4b6baaf2 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:31.223912 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031740e1-72e5-4ebc-be3a-8e5c52e88346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:31.225055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031740e1-72e5-4ebc-be3a-8e5c52e88346 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:31.225407 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031740e1-72e5-4ebc-be3a-8e5c52e88346 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:31.225691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031740e1-72e5-4ebc-be3a-8e5c52e88346 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:31.226465 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031740e1-72e5-4ebc-be3a-8e5c52e88346 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:31.226775 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031740e1-72e5-4ebc-be3a-8e5c52e88346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:31.227184 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23061da7-3e7f-4767-b5a6-adcb559b186a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:31.228206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031740e1-72e5-4ebc-be3a-8e5c52e88346 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:31.237846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 139/282] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:31.238432 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031740e1-72e5-4ebc-be3a-8e5c52e88346 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:31.273549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b36d3-c05b-4ff5-8b6f-5d8d577b00b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:31.274352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b36d3-c05b-4ff5-8b6f-5d8d577b00b3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:31.274630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b36d3-c05b-4ff5-8b6f-5d8d577b00b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:31.274910 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b36d3-c05b-4ff5-8b6f-5d8d577b00b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:31.289447 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b36d3-c05b-4ff5-8b6f-5d8d577b00b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-319b36d3-c05b-4ff5-8b6f-5d8d577b00b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:31.298438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:31.299308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:31.300269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 144/283] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:31.300919 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b36d3-c05b-4ff5-8b6f-5d8d577b00b3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:31.353715 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:31.366400 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031740e1-72e5-4ebc-be3a-8e5c52e88346 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:31.388217 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:31.413639 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77453da8-e86e-4d65-8baf-3af2a9b42c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:31.414317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77453da8-e86e-4d65-8baf-3af2a9b42c67 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:31.414604 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77453da8-e86e-4d65-8baf-3af2a9b42c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:31.414880 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77453da8-e86e-4d65-8baf-3af2a9b42c67 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:31.415628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77453da8-e86e-4d65-8baf-3af2a9b42c67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:31.415940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77453da8-e86e-4d65-8baf-3af2a9b42c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:31.417381 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77453da8-e86e-4d65-8baf-3af2a9b42c67 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:31.428494 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 140/284] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:31.429405 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77453da8-e86e-4d65-8baf-3af2a9b42c67 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:31.444933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b36d3-c05b-4ff5-8b6f-5d8d577b00b3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:31.484938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfc34e-4e06-42ff-9c49-f5874395821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:31.484938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfc34e-4e06-42ff-9c49-f5874395821e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:31.484938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfc34e-4e06-42ff-9c49-f5874395821e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:31.484938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfc34e-4e06-42ff-9c49-f5874395821e None admin] PATH_INFO: `/v3/users/b756835b1a8a4185b3c5d6242edab875` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:31.485340 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfc34e-4e06-42ff-9c49-f5874395821e None admin] RBAC: Authorizing `identity:get_user(user_id=b756835b1a8a4185b3c5d6242edab875)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:31.486556 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfc34e-4e06-42ff-9c49-f5874395821e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:31.488607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 145/285] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:31 2022] GET /identity/v3/users/b756835b1a8a4185b3c5d6242edab875 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:31.493722 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfc34e-4e06-42ff-9c49-f5874395821e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:31.564023 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77453da8-e86e-4d65-8baf-3af2a9b42c67 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:31.607991 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfc34e-4e06-42ff-9c49-f5874395821e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:31.610012 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:31.613090 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4e99d-2b7a-4673-bf57-d9c84979aea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:31.613779 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4e99d-2b7a-4673-bf57-d9c84979aea1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:31.614258 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4e99d-2b7a-4673-bf57-d9c84979aea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:31.614786 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4e99d-2b7a-4673-bf57-d9c84979aea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:31.615491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4e99d-2b7a-4673-bf57-d9c84979aea1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:31.615808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4e99d-2b7a-4673-bf57-d9c84979aea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:31.618387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4e99d-2b7a-4673-bf57-d9c84979aea1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:31.630669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 141/286] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:31.631522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4e99d-2b7a-4673-bf57-d9c84979aea1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:31.651431 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe08c9f-9e9d-46f3-82dc-a246c937dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:31.652279 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe08c9f-9e9d-46f3-82dc-a246c937dd13 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:31.652567 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe08c9f-9e9d-46f3-82dc-a246c937dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:31.652843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe08c9f-9e9d-46f3-82dc-a246c937dd13 None admin] PATH_INFO: `/v3/users/8a82617b6a1842dbb446e60c2ce0fc82` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:31.654119 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe08c9f-9e9d-46f3-82dc-a246c937dd13 None admin] RBAC: Authorizing `identity:get_user(user_id=8a82617b6a1842dbb446e60c2ce0fc82)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:31.655662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe08c9f-9e9d-46f3-82dc-a246c937dd13 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:31.657606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 146/287] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:31 2022] GET /identity/v3/users/8a82617b6a1842dbb446e60c2ce0fc82 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:31.662855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe08c9f-9e9d-46f3-82dc-a246c937dd13 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:31.683143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:31.768366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4e99d-2b7a-4673-bf57-d9c84979aea1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:31.778237 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe08c9f-9e9d-46f3-82dc-a246c937dd13 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:31.807379 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb88261-9979-4f71-af68-aea233f06db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:31.808297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb88261-9979-4f71-af68-aea233f06db8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:31.808579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb88261-9979-4f71-af68-aea233f06db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:31.808855 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb88261-9979-4f71-af68-aea233f06db8 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:31.810057 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb88261-9979-4f71-af68-aea233f06db8 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:31.811500 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb88261-9979-4f71-af68-aea233f06db8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:31.813300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 142/288] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:31 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:31.817772 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb88261-9979-4f71-af68-aea233f06db8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:31.822943 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d16493-1a07-4401-a6de-47ba6990987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:31.823846 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d16493-1a07-4401-a6de-47ba6990987e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:31.824182 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d16493-1a07-4401-a6de-47ba6990987e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:31.824465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d16493-1a07-4401-a6de-47ba6990987e None admin] PATH_INFO: `/v3/users/5c0c31f1df1c4694b9f7b368c0998ca5` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:31.844108 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d16493-1a07-4401-a6de-47ba6990987e None admin] RBAC: Authorizing `identity:get_user(user_id=5c0c31f1df1c4694b9f7b368c0998ca5)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:31.846335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d16493-1a07-4401-a6de-47ba6990987e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:31.849094 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 147/289] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:31 2022] GET /identity/v3/users/5c0c31f1df1c4694b9f7b368c0998ca5 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:31.849846 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d16493-1a07-4401-a6de-47ba6990987e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:31.885253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:31.935333 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb88261-9979-4f71-af68-aea233f06db8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:31.944901 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:31.971709 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cedfd-a346-4b84-bef1-9cdfc49b422a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:31.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cedfd-a346-4b84-bef1-9cdfc49b422a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:31.972671 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cedfd-a346-4b84-bef1-9cdfc49b422a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:31.972996 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cedfd-a346-4b84-bef1-9cdfc49b422a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:31.981590 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d16493-1a07-4401-a6de-47ba6990987e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:32.026673 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be0d0c-1c68-45d6-bdd7-25fd55d3c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:32.027602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be0d0c-1c68-45d6-bdd7-25fd55d3c54f None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:32.027931 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be0d0c-1c68-45d6-bdd7-25fd55d3c54f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:32.028215 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be0d0c-1c68-45d6-bdd7-25fd55d3c54f None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/users/b756835b1a8a4185b3c5d6242edab875/roles/5070a00cc59d4fb184e8235488c81f16` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:32.030436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be0d0c-1c68-45d6-bdd7-25fd55d3c54f None admin] RBAC: Authorizing `identity:create_grant(project_id=575de2d42ac04a449b44cc054a2e5b2c, user_id=b756835b1a8a4185b3c5d6242edab875, role_id=5070a00cc59d4fb184e8235488c81f16)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:32.031876 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be0d0c-1c68-45d6-bdd7-25fd55d3c54f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:32.048302 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 148/290] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:01:31 2022] PUT /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/users/b756835b1a8a4185b3c5d6242edab875/roles/5070a00cc59d4fb184e8235488c81f16 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:32.052726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be0d0c-1c68-45d6-bdd7-25fd55d3c54f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:32.056443 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cedfd-a346-4b84-bef1-9cdfc49b422a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:32.058093 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cedfd-a346-4b84-bef1-9cdfc49b422a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:32.176236 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 143/291] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:32.184856 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cedfd-a346-4b84-bef1-9cdfc49b422a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:32.205737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:32.211207 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:32.224351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be0d0c-1c68-45d6-bdd7-25fd55d3c54f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:32.265019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f59b-b60f-439e-9427-618f6181dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:32.265793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f59b-b60f-439e-9427-618f6181dc99 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:32.266167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f59b-b60f-439e-9427-618f6181dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:32.266510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f59b-b60f-439e-9427-618f6181dc99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:32.267416 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f59b-b60f-439e-9427-618f6181dc99 None admin] RBAC: Adding query filter params (role.id=14df33950256418dae713180ece879af, user.id=5c0c31f1df1c4694b9f7b368c0998ca5, scope.system=all) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:32.267795 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f59b-b60f-439e-9427-618f6181dc99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:32.269331 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f59b-b60f-439e-9427-618f6181dc99 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:32.275604 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 149/292] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Jul 5 10:01:32 2022] GET /identity/v3/role_assignments?user.id=5c0c31f1df1c4694b9f7b368c0998ca5&scope.system=all&role.id=14df33950256418dae713180ece879af => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:32.332221 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cedfd-a346-4b84-bef1-9cdfc49b422a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:32.375629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37a9a0-145e-4cb3-8d10-f6af693bfcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:32.376923 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37a9a0-145e-4cb3-8d10-f6af693bfcdc None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:32.377436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37a9a0-145e-4cb3-8d10-f6af693bfcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:32.377914 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37a9a0-145e-4cb3-8d10-f6af693bfcdc None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:32.379388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37a9a0-145e-4cb3-8d10-f6af693bfcdc None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:32.381174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37a9a0-145e-4cb3-8d10-f6af693bfcdc None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:32.383170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 144/293] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:32 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:32.389219 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f59b-b60f-439e-9427-618f6181dc99 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:32.531734 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f59b-b60f-439e-9427-618f6181dc99 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:32.580768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c2449-e2bd-4ac1-9d8d-03d071796322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:32.581455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2449-e2bd-4ac1-9d8d-03d071796322 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:32.581743 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2449-e2bd-4ac1-9d8d-03d071796322 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:32.582020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2449-e2bd-4ac1-9d8d-03d071796322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:32.582885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c2449-e2bd-4ac1-9d8d-03d071796322 None admin] RBAC: Adding query filter params (role.id=14df33950256418dae713180ece879af, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c, user.id=8a82617b6a1842dbb446e60c2ce0fc82) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:32.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c2449-e2bd-4ac1-9d8d-03d071796322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:32.584624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c2449-e2bd-4ac1-9d8d-03d071796322 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:32.590803 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 150/294] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:32 2022] GET /identity/v3/role_assignments?user.id=8a82617b6a1842dbb446e60c2ce0fc82&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=14df33950256418dae713180ece879af => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:33.444259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da9d31-bb9a-4e28-b68e-9f94d15c7f58 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:33.444791 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da9d31-bb9a-4e28-b68e-9f94d15c7f58 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:33.444914 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da9d31-bb9a-4e28-b68e-9f94d15c7f58 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:33.446562 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 145/295] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:33.451959 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a3802-c625-486b-967f-be88b2808ce8 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:33.452759 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a3802-c625-486b-967f-be88b2808ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:33.453266 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a3802-c625-486b-967f-be88b2808ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:33.471484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2159342-1d89-4374-b6a7-82256f49ea9e None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:33.472086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2159342-1d89-4374-b6a7-82256f49ea9e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:33.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2159342-1d89-4374-b6a7-82256f49ea9e None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:33.473938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-439a3802-c625-486b-967f-be88b2808ce8 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:33.474935 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 146/296] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:33.478167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-439a3802-c625-486b-967f-be88b2808ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:33.481690 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8a56a-9e98-49ee-8e63-ed054181c32d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:33.482401 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8a56a-9e98-49ee-8e63-ed054181c32d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:33.483047 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8a56a-9e98-49ee-8e63-ed054181c32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:33.491563 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:33.504685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e7d8a56a-9e98-49ee-8e63-ed054181c32d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:33.507089 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e7d8a56a-9e98-49ee-8e63-ed054181c32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:33.576990 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 151/297] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:33.588056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 147/298] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:33.593820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a3802-c625-486b-967f-be88b2808ce8 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:33.617316 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8a56a-9e98-49ee-8e63-ed054181c32d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:33.628636 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:33.717227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a3802-c625-486b-967f-be88b2808ce8 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:33.734537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8a56a-9e98-49ee-8e63-ed054181c32d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:33.756652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bf4ab-0453-4235-916e-eb0aeddfa7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:33.757882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bf4ab-0453-4235-916e-eb0aeddfa7be None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:33.758392 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bf4ab-0453-4235-916e-eb0aeddfa7be None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:33.758866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bf4ab-0453-4235-916e-eb0aeddfa7be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:33.770140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bf4ab-0453-4235-916e-eb0aeddfa7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:33.776050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358d077-120b-4db7-b768-d637cc440d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:33.777202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d077-120b-4db7-b768-d637cc440d5b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:33.777630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d077-120b-4db7-b768-d637cc440d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:33.778043 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d077-120b-4db7-b768-d637cc440d5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:33.779728 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358d077-120b-4db7-b768-d637cc440d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-345bf4ab-0453-4235-916e-eb0aeddfa7be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:33.781643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:33.782485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:33.783268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:33.783862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358d077-120b-4db7-b768-d637cc440d5b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:33.790430 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 148/300] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:33.790710 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 152/300] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:33.792646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358d077-120b-4db7-b768-d637cc440d5b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:33.794458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bf4ab-0453-4235-916e-eb0aeddfa7be None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:33.806219 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:33.912065 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:33.922784 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bf4ab-0453-4235-916e-eb0aeddfa7be None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:33.943853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358d077-120b-4db7-b768-d637cc440d5b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:33.967711 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffca929-8788-4c7b-9a69-21aa1882b84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:33.968693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffca929-8788-4c7b-9a69-21aa1882b84f None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:33.969036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffca929-8788-4c7b-9a69-21aa1882b84f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:33.969324 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffca929-8788-4c7b-9a69-21aa1882b84f None admin] PATH_INFO: `/v3/groups` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:33.970036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffca929-8788-4c7b-9a69-21aa1882b84f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:33.971994 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffca929-8788-4c7b-9a69-21aa1882b84f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:33.983863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8146e-2ff9-49dd-875b-f5689958bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:33.984864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8146e-2ff9-49dd-875b-f5689958bba4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:33.985596 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8146e-2ff9-49dd-875b-f5689958bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:33.986069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8146e-2ff9-49dd-875b-f5689958bba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:33.987134 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8146e-2ff9-49dd-875b-f5689958bba4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:33.987807 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8146e-2ff9-49dd-875b-f5689958bba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:33.990220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8146e-2ff9-49dd-875b-f5689958bba4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:33.998362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 153/301] 10.222.0.13 () {60 vars in 1134 bytes} [Tue Jul 5 10:01:33 2022] POST /identity/v3/groups => generated 229 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:01:34.003747 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 149/302] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:34.010133 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffca929-8788-4c7b-9a69-21aa1882b84f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:34.089466 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:34.130005 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffca929-8788-4c7b-9a69-21aa1882b84f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:34.168220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92329f31-5621-4fc2-b9f1-14e97fb09328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:34.169320 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329f31-5621-4fc2-b9f1-14e97fb09328 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:34.169656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329f31-5621-4fc2-b9f1-14e97fb09328 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:34.169940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329f31-5621-4fc2-b9f1-14e97fb09328 None admin] PATH_INFO: `/v3/users/86a5ea803d59463f98f9da7b5281d7fb` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:34.184944 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92329f31-5621-4fc2-b9f1-14e97fb09328 None admin] RBAC: Authorizing `identity:get_user(user_id=86a5ea803d59463f98f9da7b5281d7fb)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:34.186499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92329f31-5621-4fc2-b9f1-14e97fb09328 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:34.188288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 154/303] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:34 2022] GET /identity/v3/users/86a5ea803d59463f98f9da7b5281d7fb => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:34.194738 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8146e-2ff9-49dd-875b-f5689958bba4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:34.307675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8146e-2ff9-49dd-875b-f5689958bba4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:34.312742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbee9da-4eaf-4a9c-aeba-b6cba71c221a None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:34.313070 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbee9da-4eaf-4a9c-aeba-b6cba71c221a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:34.313353 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbee9da-4eaf-4a9c-aeba-b6cba71c221a None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:34.314875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 155/304] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:34.319992 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61da3c-aa4d-4ba1-9277-6cf97d704b7e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:34.320530 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61da3c-aa4d-4ba1-9277-6cf97d704b7e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:34.321077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61da3c-aa4d-4ba1-9277-6cf97d704b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:34.338666 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9b61da3c-aa4d-4ba1-9277-6cf97d704b7e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:34.339848 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9b61da3c-aa4d-4ba1-9277-6cf97d704b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:34.357868 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef6ae4-ade7-48a7-8718-ab4bcd108355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:34.358910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6ae4-ade7-48a7-8718-ab4bcd108355 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:34.359465 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6ae4-ade7-48a7-8718-ab4bcd108355 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:34.359959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6ae4-ade7-48a7-8718-ab4bcd108355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:34.361023 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef6ae4-ade7-48a7-8718-ab4bcd108355 None admin] RBAC: Adding query filter params (role.id=5070a00cc59d4fb184e8235488c81f16, user.id=86a5ea803d59463f98f9da7b5281d7fb, scope.system=all) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:34.361540 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef6ae4-ade7-48a7-8718-ab4bcd108355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:34.363190 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef6ae4-ade7-48a7-8718-ab4bcd108355 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:34.372931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:34.373553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 150/305] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Jul 5 10:01:34 2022] GET /identity/v3/role_assignments?user.id=86a5ea803d59463f98f9da7b5281d7fb&scope.system=all&role.id=5070a00cc59d4fb184e8235488c81f16 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:34.417479 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 156/306] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:34.441023 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef6ae4-ade7-48a7-8718-ab4bcd108355 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:34.556096 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef6ae4-ade7-48a7-8718-ab4bcd108355 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:34.559277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5aa8-8dfb-4dc1-9e5e-7512d261cefe None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:34.559677 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5aa8-8dfb-4dc1-9e5e-7512d261cefe None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:34.559880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf5aa8-8dfb-4dc1-9e5e-7512d261cefe None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:34.561438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 157/307] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:34.566887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1583f2-3374-4708-b029-720c9a1baacd None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:34.568011 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1583f2-3374-4708-b029-720c9a1baacd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:34.568542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1583f2-3374-4708-b029-720c9a1baacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:34.586543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-bc1583f2-3374-4708-b029-720c9a1baacd None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:34.588142 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bc1583f2-3374-4708-b029-720c9a1baacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:34.591958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527aaf87-d2ec-447e-9be3-1d044cb86cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:34.592937 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aaf87-d2ec-447e-9be3-1d044cb86cfd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:34.593229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aaf87-d2ec-447e-9be3-1d044cb86cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:34.593504 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aaf87-d2ec-447e-9be3-1d044cb86cfd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:34.604129 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aaf87-d2ec-447e-9be3-1d044cb86cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-527aaf87-d2ec-447e-9be3-1d044cb86cfd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:34.612131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:34.613048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:34.613873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 151/308] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:34.620157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527aaf87-d2ec-447e-9be3-1d044cb86cfd None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:34.647748 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:34.673015 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 158/309] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:34.693853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:34.695176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1583f2-3374-4708-b029-720c9a1baacd None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:34.742161 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527aaf87-d2ec-447e-9be3-1d044cb86cfd None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:34.777593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6912fb-7636-4eab-9374-3edb9882dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:34.778885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6912fb-7636-4eab-9374-3edb9882dc7a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:34.779390 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6912fb-7636-4eab-9374-3edb9882dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:34.780015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6912fb-7636-4eab-9374-3edb9882dc7a None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:34.781757 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6912fb-7636-4eab-9374-3edb9882dc7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:34.782268 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6912fb-7636-4eab-9374-3edb9882dc7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:34.783846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6912fb-7636-4eab-9374-3edb9882dc7a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:34.795874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 152/310] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:34.802436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6912fb-7636-4eab-9374-3edb9882dc7a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:34.815801 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1583f2-3374-4708-b029-720c9a1baacd None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:34.852733 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba994c6-e1d7-40a8-9a85-4b8ed727149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:34.854015 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba994c6-e1d7-40a8-9a85-4b8ed727149e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:34.854518 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba994c6-e1d7-40a8-9a85-4b8ed727149e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:34.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba994c6-e1d7-40a8-9a85-4b8ed727149e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:34.867266 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba994c6-e1d7-40a8-9a85-4b8ed727149e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-3ba994c6-e1d7-40a8-9a85-4b8ed727149e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:34.875712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:34.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:34.877394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:34.884746 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 159/311] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:34.885991 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba994c6-e1d7-40a8-9a85-4b8ed727149e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:34.908001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6912fb-7636-4eab-9374-3edb9882dc7a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:34.934632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:34.941280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:34.949574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b8a1-69e7-40aa-b00b-a131d91f8952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:34.950543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b8a1-69e7-40aa-b00b-a131d91f8952 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:34.950871 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b8a1-69e7-40aa-b00b-a131d91f8952 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:34.951071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b8a1-69e7-40aa-b00b-a131d91f8952 None admin] PATH_INFO: `/v3/users/b756835b1a8a4185b3c5d6242edab875` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:34.952410 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5b8a1-69e7-40aa-b00b-a131d91f8952 None admin] RBAC: Authorizing `identity:get_user(user_id=b756835b1a8a4185b3c5d6242edab875)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:34.954233 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5b8a1-69e7-40aa-b00b-a131d91f8952 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:34.961269 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 153/312] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:34 2022] GET /identity/v3/users/b756835b1a8a4185b3c5d6242edab875 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:34.962154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b8a1-69e7-40aa-b00b-a131d91f8952 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:34.994938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba994c6-e1d7-40a8-9a85-4b8ed727149e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:35.029766 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04bd50-ba38-4734-bfac-c0b8a83481de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:35.030701 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04bd50-ba38-4734-bfac-c0b8a83481de None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:35.031191 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04bd50-ba38-4734-bfac-c0b8a83481de None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:35.031651 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04bd50-ba38-4734-bfac-c0b8a83481de None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:35.032654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04bd50-ba38-4734-bfac-c0b8a83481de None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:35.033156 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04bd50-ba38-4734-bfac-c0b8a83481de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:35.034903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04bd50-ba38-4734-bfac-c0b8a83481de None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:35.044752 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 160/313] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:35.055734 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04bd50-ba38-4734-bfac-c0b8a83481de None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:35.076021 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b8a1-69e7-40aa-b00b-a131d91f8952 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:35.110364 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5e30-f9da-4527-af5b-9e78475fa50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:35.110747 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5e30-f9da-4527-af5b-9e78475fa50e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:35.111032 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5e30-f9da-4527-af5b-9e78475fa50e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:35.111305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5e30-f9da-4527-af5b-9e78475fa50e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:35.172875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:35.187858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c5e30-f9da-4527-af5b-9e78475fa50e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:35.190996 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c5e30-f9da-4527-af5b-9e78475fa50e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:35.197375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04bd50-ba38-4734-bfac-c0b8a83481de None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:35.204826 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:35.236189 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a7f5c-36a2-4d4c-83b9-b92effda37c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:35.237453 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a7f5c-36a2-4d4c-83b9-b92effda37c1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:35.237936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a7f5c-36a2-4d4c-83b9-b92effda37c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:35.238426 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a7f5c-36a2-4d4c-83b9-b92effda37c1 None admin] PATH_INFO: `/v3/users/5c0c31f1df1c4694b9f7b368c0998ca5` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:35.240419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a7f5c-36a2-4d4c-83b9-b92effda37c1 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0c31f1df1c4694b9f7b368c0998ca5)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:35.242115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a7f5c-36a2-4d4c-83b9-b92effda37c1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:35.244262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 161/314] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:35 2022] GET /identity/v3/users/5c0c31f1df1c4694b9f7b368c0998ca5 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:35.249380 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a7f5c-36a2-4d4c-83b9-b92effda37c1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:35.298519 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 154/315] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:35.306585 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5e30-f9da-4527-af5b-9e78475fa50e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:35.356064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a7f5c-36a2-4d4c-83b9-b92effda37c1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:35.391030 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9f31a-e6e6-45da-b19c-9e59c5e905d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:35.391893 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f31a-e6e6-45da-b19c-9e59c5e905d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:35.392179 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f31a-e6e6-45da-b19c-9e59c5e905d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:35.392466 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f31a-e6e6-45da-b19c-9e59c5e905d2 None admin] PATH_INFO: `/v3/system/users/5c0c31f1df1c4694b9f7b368c0998ca5/roles/14df33950256418dae713180ece879af` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:35.393978 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9f31a-e6e6-45da-b19c-9e59c5e905d2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5c0c31f1df1c4694b9f7b368c0998ca5, role_id=14df33950256418dae713180ece879af)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:35.395911 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9f31a-e6e6-45da-b19c-9e59c5e905d2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:35.404931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:35.408575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 162/316] 10.222.0.13 () {58 vars in 1334 bytes} [Tue Jul 5 10:01:35 2022] PUT /identity/v3/system/users/5c0c31f1df1c4694b9f7b368c0998ca5/roles/14df33950256418dae713180ece879af => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 10:01:35.427380 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5e30-f9da-4527-af5b-9e78475fa50e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:35.469188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f61e4-c515-41f6-9aed-11a9e4de0b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:35.470040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f61e4-c515-41f6-9aed-11a9e4de0b5d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:35.470320 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f61e4-c515-41f6-9aed-11a9e4de0b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:35.470596 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f61e4-c515-41f6-9aed-11a9e4de0b5d None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:35.471894 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f61e4-c515-41f6-9aed-11a9e4de0b5d None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:35.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f61e4-c515-41f6-9aed-11a9e4de0b5d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:35.475514 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 155/317] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:35 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:35.481420 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9f31a-e6e6-45da-b19c-9e59c5e905d2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:35.529321 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:35.603286 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9f31a-e6e6-45da-b19c-9e59c5e905d2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:35.641336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054fa34-f404-46d7-95c0-5c8bc26b6205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:35.642234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054fa34-f404-46d7-95c0-5c8bc26b6205 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:35.642659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054fa34-f404-46d7-95c0-5c8bc26b6205 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:35.643103 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054fa34-f404-46d7-95c0-5c8bc26b6205 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:35.644105 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054fa34-f404-46d7-95c0-5c8bc26b6205 None admin] RBAC: Adding query filter params (role.id=5070a00cc59d4fb184e8235488c81f16, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c, user.id=b756835b1a8a4185b3c5d6242edab875) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:35.644565 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054fa34-f404-46d7-95c0-5c8bc26b6205 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:35.646868 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054fa34-f404-46d7-95c0-5c8bc26b6205 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:35.653146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 163/318] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:01:35 2022] GET /identity/v3/role_assignments?user.id=b756835b1a8a4185b3c5d6242edab875&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=5070a00cc59d4fb184e8235488c81f16 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:36.169818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3603-157c-40d3-b261-61fe1ab0a6f9 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:36.170329 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3603-157c-40d3-b261-61fe1ab0a6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:36.170403 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3603-157c-40d3-b261-61fe1ab0a6f9 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:36.171891 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 156/319] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:36.177987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a6e49-85db-4c43-983c-51d008070a04 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:36.178285 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a6e49-85db-4c43-983c-51d008070a04 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:36.178566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a6e49-85db-4c43-983c-51d008070a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:36.196527 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ad5a6e49-85db-4c43-983c-51d008070a04 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:36.197786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ad5a6e49-85db-4c43-983c-51d008070a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:36.266041 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 164/320] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:36.288686 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e3603-157c-40d3-b261-61fe1ab0a6f9 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:36.391385 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e3603-157c-40d3-b261-61fe1ab0a6f9 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:36.424933 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd759d8-3ba0-4559-ba7c-1e26b7677baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:36.425659 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd759d8-3ba0-4559-ba7c-1e26b7677baf None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:36.425943 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd759d8-3ba0-4559-ba7c-1e26b7677baf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:36.426220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd759d8-3ba0-4559-ba7c-1e26b7677baf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:36.428150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd759d8-3ba0-4559-ba7c-1e26b7677baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:36.429631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd759d8-3ba0-4559-ba7c-1e26b7677baf None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:36.431407 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 157/321] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:36.436694 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a6e49-85db-4c43-983c-51d008070a04 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:36.467745 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:36.483302 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba9be-a5a3-45ab-bfa8-3b5e697d1701 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:36.483595 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba9be-a5a3-45ab-bfa8-3b5e697d1701 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:36.483873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ba9be-a5a3-45ab-bfa8-3b5e697d1701 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:36.485394 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 158/322] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:36.489991 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752abc4-b55d-4855-b428-ce8bb6bf5b82 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:36.490279 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752abc4-b55d-4855-b428-ce8bb6bf5b82 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:36.490559 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752abc4-b55d-4855-b428-ce8bb6bf5b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:36.506590 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a752abc4-b55d-4855-b428-ce8bb6bf5b82 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:36.507768 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a752abc4-b55d-4855-b428-ce8bb6bf5b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:36.528477 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:36.546228 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a6e49-85db-4c43-983c-51d008070a04 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:36.581038 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 159/323] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:36.587529 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eee551-bf40-446b-b744-b409f4054e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:36.588210 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eee551-bf40-446b-b744-b409f4054e62 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:36.588498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eee551-bf40-446b-b744-b409f4054e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:36.588777 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eee551-bf40-446b-b744-b409f4054e62 None admin] PATH_INFO: `/v3/groups` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:36.589515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eee551-bf40-446b-b744-b409f4054e62 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:36.590959 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eee551-bf40-446b-b744-b409f4054e62 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:36.605160 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752abc4-b55d-4855-b428-ce8bb6bf5b82 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:36.609182 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 165/324] 10.222.0.13 () {60 vars in 1134 bytes} [Tue Jul 5 10:01:36 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:36.716769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752abc4-b55d-4855-b428-ce8bb6bf5b82 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:36.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5a481-1f7c-472e-85ba-870150e4d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:36.754949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a481-1f7c-472e-85ba-870150e4d7bb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:36.755235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a481-1f7c-472e-85ba-870150e4d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:36.755517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a481-1f7c-472e-85ba-870150e4d7bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:36.766506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5a481-1f7c-472e-85ba-870150e4d7bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-99b5a481-1f7c-472e-85ba-870150e4d7bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:36.774706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:36.775761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:36.776614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 160/325] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:36.782114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eee551-bf40-446b-b744-b409f4054e62 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:36.882894 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:36.892726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eee551-bf40-446b-b744-b409f4054e62 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:36.933075 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8e064-de7d-49de-934d-e597baa841b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:36.933766 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e064-de7d-49de-934d-e597baa841b7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:36.934051 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e064-de7d-49de-934d-e597baa841b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:36.934394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e064-de7d-49de-934d-e597baa841b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:36.935092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8e064-de7d-49de-934d-e597baa841b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:36.935396 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8e064-de7d-49de-934d-e597baa841b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:36.936783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8e064-de7d-49de-934d-e597baa841b7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:36.950307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 166/326] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:36.951695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5a481-1f7c-472e-85ba-870150e4d7bb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:36.974976 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:37.063356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5a481-1f7c-472e-85ba-870150e4d7bb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:37.100587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b83cb1-c340-464b-9788-6c363c58358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:37.101890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b83cb1-c340-464b-9788-6c363c58358e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:37.102415 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b83cb1-c340-464b-9788-6c363c58358e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:37.102901 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b83cb1-c340-464b-9788-6c363c58358e None admin] PATH_INFO: `/v3/users/86a5ea803d59463f98f9da7b5281d7fb` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:37.104440 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b83cb1-c340-464b-9788-6c363c58358e None admin] RBAC: Authorizing `identity:get_user(user_id=86a5ea803d59463f98f9da7b5281d7fb)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:37.106179 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b83cb1-c340-464b-9788-6c363c58358e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:37.108031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 161/327] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:36 2022] GET /identity/v3/users/86a5ea803d59463f98f9da7b5281d7fb => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:37.117423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8e064-de7d-49de-934d-e597baa841b7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:37.245450 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8e064-de7d-49de-934d-e597baa841b7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:37.289842 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a117d2-2f10-4c5c-90f3-03663e26be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:37.290736 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a117d2-2f10-4c5c-90f3-03663e26be7f None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:37.291021 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a117d2-2f10-4c5c-90f3-03663e26be7f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:37.291303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a117d2-2f10-4c5c-90f3-03663e26be7f None admin] PATH_INFO: `/v3/system/users/86a5ea803d59463f98f9da7b5281d7fb/roles/5070a00cc59d4fb184e8235488c81f16` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:37.294265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a117d2-2f10-4c5c-90f3-03663e26be7f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=86a5ea803d59463f98f9da7b5281d7fb, role_id=5070a00cc59d4fb184e8235488c81f16)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:37.295455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a117d2-2f10-4c5c-90f3-03663e26be7f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:37.319911 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 167/328] 10.222.0.13 () {58 vars in 1334 bytes} [Tue Jul 5 10:01:37 2022] PUT /identity/v3/system/users/86a5ea803d59463f98f9da7b5281d7fb/roles/5070a00cc59d4fb184e8235488c81f16 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:37.595842 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615936ff-5d59-4f23-90ca-4c180f2d6418 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:37.596861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615936ff-5d59-4f23-90ca-4c180f2d6418 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:37.597381 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615936ff-5d59-4f23-90ca-4c180f2d6418 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:37.599787 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 162/329] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:37.605258 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9873b3-0f65-46b9-b8ab-89c8925b4bc9 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:37.605916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9873b3-0f65-46b9-b8ab-89c8925b4bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:37.606417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9873b3-0f65-46b9-b8ab-89c8925b4bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:37.625486 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-fb9873b3-0f65-46b9-b8ab-89c8925b4bc9 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:37.627462 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-fb9873b3-0f65-46b9-b8ab-89c8925b4bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:37.650123 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:37.719717 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 168/330] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:37.746658 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615936ff-5d59-4f23-90ca-4c180f2d6418 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:37.855144 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:37.874409 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615936ff-5d59-4f23-90ca-4c180f2d6418 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:37.909113 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c191fb3-52e8-4e8a-af2d-8aadf351050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:37.909920 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c191fb3-52e8-4e8a-af2d-8aadf351050f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:37.910204 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c191fb3-52e8-4e8a-af2d-8aadf351050f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:37.910486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c191fb3-52e8-4e8a-af2d-8aadf351050f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:37.922920 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c191fb3-52e8-4e8a-af2d-8aadf351050f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0c191fb3-52e8-4e8a-af2d-8aadf351050f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:37.931501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:37.932348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:37.933169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 163/331] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:37.938540 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9873b3-0f65-46b9-b8ab-89c8925b4bc9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:38.062642 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9873b3-0f65-46b9-b8ab-89c8925b4bc9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:38.106245 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e057f-6791-49ca-af17-3e481803171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:38.107261 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e057f-6791-49ca-af17-3e481803171b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:38.107744 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e057f-6791-49ca-af17-3e481803171b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:38.108232 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e057f-6791-49ca-af17-3e481803171b None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:38.109269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e057f-6791-49ca-af17-3e481803171b None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:38.109776 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e057f-6791-49ca-af17-3e481803171b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:38.111363 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e057f-6791-49ca-af17-3e481803171b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:38.125163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 169/332] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:38.134047 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c191fb3-52e8-4e8a-af2d-8aadf351050f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:38.270895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c191fb3-52e8-4e8a-af2d-8aadf351050f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:38.322216 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e3c8b-dd2a-4241-b1d0-f04b16649759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:38.323112 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e3c8b-dd2a-4241-b1d0-f04b16649759 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:38.323399 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e3c8b-dd2a-4241-b1d0-f04b16649759 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:38.323679 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e3c8b-dd2a-4241-b1d0-f04b16649759 None admin] PATH_INFO: `/v3/users/5c0c31f1df1c4694b9f7b368c0998ca5` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:38.324913 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e3c8b-dd2a-4241-b1d0-f04b16649759 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0c31f1df1c4694b9f7b368c0998ca5)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:38.326478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e3c8b-dd2a-4241-b1d0-f04b16649759 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:38.328278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 164/333] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:38 2022] GET /identity/v3/users/5c0c31f1df1c4694b9f7b368c0998ca5 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:38.333946 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e057f-6791-49ca-af17-3e481803171b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:38.381402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:38.452597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e057f-6791-49ca-af17-3e481803171b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:38.489500 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843acd9-2e6a-42e0-ab6a-ae33f9f64f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:38.490482 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843acd9-2e6a-42e0-ab6a-ae33f9f64f76 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:38.490988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843acd9-2e6a-42e0-ab6a-ae33f9f64f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:38.491454 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843acd9-2e6a-42e0-ab6a-ae33f9f64f76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:38.492467 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843acd9-2e6a-42e0-ab6a-ae33f9f64f76 None admin] RBAC: Adding query filter params (role.id=14df33950256418dae713180ece879af, user.id=5c0c31f1df1c4694b9f7b368c0998ca5, scope.system=all) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:38.493039 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843acd9-2e6a-42e0-ab6a-ae33f9f64f76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:38.494666 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843acd9-2e6a-42e0-ab6a-ae33f9f64f76 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:38.507362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 170/334] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Jul 5 10:01:38 2022] GET /identity/v3/role_assignments?user.id=5c0c31f1df1c4694b9f7b368c0998ca5&scope.system=all&role.id=14df33950256418dae713180ece879af => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:39.619634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d9c6-a94c-4cd1-a682-5637f56b453f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:39.620617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d9c6-a94c-4cd1-a682-5637f56b453f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:39.621140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d9c6-a94c-4cd1-a682-5637f56b453f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:39.623004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 165/335] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:39.638455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fed5f1-c547-49a4-8b6b-b0b6a7c75e38 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:39.639375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fed5f1-c547-49a4-8b6b-b0b6a7c75e38 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:39.639854 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fed5f1-c547-49a4-8b6b-b0b6a7c75e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:39.661444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c8fed5f1-c547-49a4-8b6b-b0b6a7c75e38 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:39.662954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c8fed5f1-c547-49a4-8b6b-b0b6a7c75e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:39.742443 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:39.748862 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 171/336] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:39.780912 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439d9c6-a94c-4cd1-a682-5637f56b453f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:39.797931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:39.898880 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439d9c6-a94c-4cd1-a682-5637f56b453f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:39.938921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920c133-3a30-4c99-ab73-7f467e566119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:39.939767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920c133-3a30-4c99-ab73-7f467e566119 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:39.940054 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920c133-3a30-4c99-ab73-7f467e566119 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:39.940324 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920c133-3a30-4c99-ab73-7f467e566119 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:39.951987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920c133-3a30-4c99-ab73-7f467e566119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-2920c133-3a30-4c99-ab73-7f467e566119 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:39.964804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:39.965712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:39.966493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 166/337] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:39.972215 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fed5f1-c547-49a4-8b6b-b0b6a7c75e38 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:40.081505 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fed5f1-c547-49a4-8b6b-b0b6a7c75e38 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:40.126907 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af32649-8ac0-4c93-9686-ba3e2603afce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:40.127593 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af32649-8ac0-4c93-9686-ba3e2603afce None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:40.127876 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af32649-8ac0-4c93-9686-ba3e2603afce None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:40.128153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af32649-8ac0-4c93-9686-ba3e2603afce None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:40.128919 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af32649-8ac0-4c93-9686-ba3e2603afce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:40.129235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af32649-8ac0-4c93-9686-ba3e2603afce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:40.131142 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af32649-8ac0-4c93-9686-ba3e2603afce None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:40.144601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 172/338] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:40.150894 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920c133-3a30-4c99-ab73-7f467e566119 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:40.207950 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd417f2-e2c1-4df8-bb2a-a3f431acd297 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:40.208255 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd417f2-e2c1-4df8-bb2a-a3f431acd297 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:40.208522 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd417f2-e2c1-4df8-bb2a-a3f431acd297 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:40.211053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 173/339] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:40.216343 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4f03f-4756-416b-ad6d-7f1e4c4f7b7f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:40.216926 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4f03f-4756-416b-ad6d-7f1e4c4f7b7f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:40.217218 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4f03f-4756-416b-ad6d-7f1e4c4f7b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:40.244698 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f9b4f03f-4756-416b-ad6d-7f1e4c4f7b7f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:40.247707 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:40.249499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f9b4f03f-4756-416b-ad6d-7f1e4c4f7b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:40.321506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920c133-3a30-4c99-ab73-7f467e566119 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:40.365259 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:40.382916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 174/340] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:40.385252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd5c3-904f-415f-bc0e-4870d117c6bf None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:40.385546 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd5c3-904f-415f-bc0e-4870d117c6bf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:40.385828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd5c3-904f-415f-bc0e-4870d117c6bf None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:40.387256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 175/341] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:40.390183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e7e1e-99cf-4adf-9355-6ad5007cd7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:40.391015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7e1e-99cf-4adf-9355-6ad5007cd7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:40.391443 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7e1e-99cf-4adf-9355-6ad5007cd7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:40.391851 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e7e1e-99cf-4adf-9355-6ad5007cd7d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:40.393195 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220932c-38d9-4338-94a0-80a03006b48e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:40.393644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220932c-38d9-4338-94a0-80a03006b48e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:40.394679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220932c-38d9-4338-94a0-80a03006b48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:40.425086 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e220932c-38d9-4338-94a0-80a03006b48e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:40.426539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e220932c-38d9-4338-94a0-80a03006b48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:40.513784 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 176/342] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:40.515148 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220932c-38d9-4338-94a0-80a03006b48e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:40.517811 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e7e1e-99cf-4adf-9355-6ad5007cd7d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:40.519519 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e7e1e-99cf-4adf-9355-6ad5007cd7d1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:40.600531 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:40.639097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 167/343] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:40.641964 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021440d-baf0-495a-860e-4881c9b0bc45 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:40.642502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021440d-baf0-495a-860e-4881c9b0bc45 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:40.643232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021440d-baf0-495a-860e-4881c9b0bc45 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:40.646248 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 168/344] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:40.647153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021440d-baf0-495a-860e-4881c9b0bc45 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:40.661930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220932c-38d9-4338-94a0-80a03006b48e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:40.685215 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:40.709163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda642f6-4823-47c5-abc2-b83d95383865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:40.710263 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda642f6-4823-47c5-abc2-b83d95383865 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:40.710685 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda642f6-4823-47c5-abc2-b83d95383865 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:40.711139 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda642f6-4823-47c5-abc2-b83d95383865 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:40.723748 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda642f6-4823-47c5-abc2-b83d95383865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-cda642f6-4823-47c5-abc2-b83d95383865 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:40.732936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:40.733807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 10:01:40.734612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:40.737296 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 177/345] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:40.738355 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda642f6-4823-47c5-abc2-b83d95383865 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:40.779530 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021440d-baf0-495a-860e-4881c9b0bc45 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:40.828771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df5ee7-62a9-44ba-b824-e839cf5a3e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:40.829619 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5ee7-62a9-44ba-b824-e839cf5a3e46 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:40.829907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5ee7-62a9-44ba-b824-e839cf5a3e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:40.830644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5ee7-62a9-44ba-b824-e839cf5a3e46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:40.844814 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df5ee7-62a9-44ba-b824-e839cf5a3e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:40.856734 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda642f6-4823-47c5-abc2-b83d95383865 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-58df5ee7-62a9-44ba-b824-e839cf5a3e46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:40.857526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:40.858573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:40.859620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 169/346] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:40.860361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50ae9-21a3-466e-8b6e-1bfe6de56fe3 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:40.860507 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50ae9-21a3-466e-8b6e-1bfe6de56fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:40.860785 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50ae9-21a3-466e-8b6e-1bfe6de56fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:40.882092 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-69c50ae9-21a3-466e-8b6e-1bfe6de56fe3 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:40.883688 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-69c50ae9-21a3-466e-8b6e-1bfe6de56fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:40.901975 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eae4a-806c-40f9-9455-225e4368816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:40.903065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eae4a-806c-40f9-9455-225e4368816b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:40.903510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eae4a-806c-40f9-9455-225e4368816b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:40.903976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eae4a-806c-40f9-9455-225e4368816b None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:40.905398 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505eae4a-806c-40f9-9455-225e4368816b None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:40.907132 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505eae4a-806c-40f9-9455-225e4368816b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:40.909057 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 178/347] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:40 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:40.909944 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eae4a-806c-40f9-9455-225e4368816b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:40.916417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:40.969106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 170/348] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:40.970567 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c50ae9-21a3-466e-8b6e-1bfe6de56fe3 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:40.971080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:41.044239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eae4a-806c-40f9-9455-225e4368816b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:41.095563 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f17a0-f249-4797-944a-b9e063114b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:41.096632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f17a0-f249-4797-944a-b9e063114b29 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:41.097816 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f17a0-f249-4797-944a-b9e063114b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:41.097816 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f17a0-f249-4797-944a-b9e063114b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:41.098132 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f17a0-f249-4797-944a-b9e063114b29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:41.099484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f17a0-f249-4797-944a-b9e063114b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:41.100880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f17a0-f249-4797-944a-b9e063114b29 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:41.118615 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c50ae9-21a3-466e-8b6e-1bfe6de56fe3 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:41.118801 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 179/349] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:41.118801 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f17a0-f249-4797-944a-b9e063114b29 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:41.158452 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f18c7-1e60-4760-be77-263a8168e0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:41.159287 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f18c7-1e60-4760-be77-263a8168e0bf None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:41.159571 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f18c7-1e60-4760-be77-263a8168e0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:41.159994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f18c7-1e60-4760-be77-263a8168e0bf None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:41.161358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f18c7-1e60-4760-be77-263a8168e0bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:41.161669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f18c7-1e60-4760-be77-263a8168e0bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:41.163055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f18c7-1e60-4760-be77-263a8168e0bf None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:41.174057 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 171/350] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:41.175789 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80301b-1e26-4c2a-9e26-8f0012f5853b None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:41.176084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80301b-1e26-4c2a-9e26-8f0012f5853b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:41.176926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80301b-1e26-4c2a-9e26-8f0012f5853b None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:41.178325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 172/351] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:41.178869 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80301b-1e26-4c2a-9e26-8f0012f5853b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:41.208454 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:41.256512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f17a0-f249-4797-944a-b9e063114b29 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:41.267413 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:41.298744 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2ce6d-aec0-4a93-8765-287f111fe4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:41.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ce6d-aec0-4a93-8765-287f111fe4ff None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:41.300010 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ce6d-aec0-4a93-8765-287f111fe4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:41.300284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ce6d-aec0-4a93-8765-287f111fe4ff None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:41.309229 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2ce6d-aec0-4a93-8765-287f111fe4ff None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:41.310697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2ce6d-aec0-4a93-8765-287f111fe4ff None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:41.312581 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 180/352] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:41 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:41.313258 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2ce6d-aec0-4a93-8765-287f111fe4ff None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:41.324863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80301b-1e26-4c2a-9e26-8f0012f5853b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:41.371749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae385e3-ee4d-4f8d-aab8-52833c3ed3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:41.372878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae385e3-ee4d-4f8d-aab8-52833c3ed3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:41.373017 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae385e3-ee4d-4f8d-aab8-52833c3ed3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:41.374485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae385e3-ee4d-4f8d-aab8-52833c3ed3b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:41.393090 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae385e3-ee4d-4f8d-aab8-52833c3ed3b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1ae385e3-ee4d-4f8d-aab8-52833c3ed3b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:41.401079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:41.401998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:41.402784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 173/353] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:41.405458 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae385e3-ee4d-4f8d-aab8-52833c3ed3b9 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:41.451848 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2ce6d-aec0-4a93-8765-287f111fe4ff None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:41.498539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d0945-ae19-43d4-9c68-bdbd88cb5f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:41.499447 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d0945-ae19-43d4-9c68-bdbd88cb5f46 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:41.499733 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d0945-ae19-43d4-9c68-bdbd88cb5f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:41.500016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d0945-ae19-43d4-9c68-bdbd88cb5f46 None admin] PATH_INFO: `/v3/users/86a5ea803d59463f98f9da7b5281d7fb` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:41.501281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d0945-ae19-43d4-9c68-bdbd88cb5f46 None admin] RBAC: Authorizing `identity:get_user(user_id=86a5ea803d59463f98f9da7b5281d7fb)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:41.503539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d0945-ae19-43d4-9c68-bdbd88cb5f46 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:41.505131 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 181/354] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:01:41 2022] GET /identity/v3/users/86a5ea803d59463f98f9da7b5281d7fb => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:41.506324 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c92d97-f03d-4ef1-95bc-98cc0b8c63ad None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:41.506687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c92d97-f03d-4ef1-95bc-98cc0b8c63ad None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:41.506926 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c92d97-f03d-4ef1-95bc-98cc0b8c63ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:41.521970 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:41.526760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f2c92d97-f03d-4ef1-95bc-98cc0b8c63ad None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:41.528131 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f2c92d97-f03d-4ef1-95bc-98cc0b8c63ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:41.542084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae385e3-ee4d-4f8d-aab8-52833c3ed3b9 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:41.574723 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:41.588176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa5528-cc53-4f6f-bca9-92dc7583b950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:41.588836 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa5528-cc53-4f6f-bca9-92dc7583b950 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:41.589146 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa5528-cc53-4f6f-bca9-92dc7583b950 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:41.589424 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa5528-cc53-4f6f-bca9-92dc7583b950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:41.615737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 182/355] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:41.617094 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c92d97-f03d-4ef1-95bc-98cc0b8c63ad None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:41.684608 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa5528-cc53-4f6f-bca9-92dc7583b950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:41.686132 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa5528-cc53-4f6f-bca9-92dc7583b950 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:41.739080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c92d97-f03d-4ef1-95bc-98cc0b8c63ad None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:41.778341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fe886-f594-4a4c-987d-f3c349fcf332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:41.778937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fe886-f594-4a4c-987d-f3c349fcf332 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:41.779228 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fe886-f594-4a4c-987d-f3c349fcf332 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:41.779509 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fe886-f594-4a4c-987d-f3c349fcf332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:41.780928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fe886-f594-4a4c-987d-f3c349fcf332 None admin] RBAC: Adding query filter params (group.id=c1069df7a1bb4dbe965322f28bd04199, role.id=a11101f17a5c44e5b5454f2f8af57cf3, scope.project.id=6055d4c138374609abba19bcdd29bb97) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:41.780928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fe886-f594-4a4c-987d-f3c349fcf332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:41.782417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fe886-f594-4a4c-987d-f3c349fcf332 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:41.787594 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:41.790077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 183/356] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 10:01:41 2022] GET /identity/v3/role_assignments?group.id=c1069df7a1bb4dbe965322f28bd04199&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=a11101f17a5c44e5b5454f2f8af57cf3 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:41.790861 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fe886-f594-4a4c-987d-f3c349fcf332 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:41.823876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 174/357] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:41.823876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa5528-cc53-4f6f-bca9-92dc7583b950 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:41.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:41.925402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fe886-f594-4a4c-987d-f3c349fcf332 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:41.959615 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa5528-cc53-4f6f-bca9-92dc7583b950 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:41.968601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681eb78-3b30-4121-8f19-1aba4860d032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:41.969304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681eb78-3b30-4121-8f19-1aba4860d032 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:41.969590 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681eb78-3b30-4121-8f19-1aba4860d032 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:41.969865 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681eb78-3b30-4121-8f19-1aba4860d032 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:41.970604 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681eb78-3b30-4121-8f19-1aba4860d032 None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:41.970910 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681eb78-3b30-4121-8f19-1aba4860d032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:41.972274 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681eb78-3b30-4121-8f19-1aba4860d032 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:41.983143 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 184/358] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:41.984276 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681eb78-3b30-4121-8f19-1aba4860d032 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:42.007794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca48689-5283-4083-a753-6219cb5da4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:42.008775 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca48689-5283-4083-a753-6219cb5da4fe None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:42.009251 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca48689-5283-4083-a753-6219cb5da4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:42.009703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca48689-5283-4083-a753-6219cb5da4fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:42.011657 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca48689-5283-4083-a753-6219cb5da4fe None admin] RBAC: Adding query filter params (role.id=5070a00cc59d4fb184e8235488c81f16, user.id=86a5ea803d59463f98f9da7b5281d7fb, scope.system=all) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:42.012199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca48689-5283-4083-a753-6219cb5da4fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:42.013924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca48689-5283-4083-a753-6219cb5da4fe None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:42.027665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 175/359] 10.222.0.13 () {56 vars in 1308 bytes} [Tue Jul 5 10:01:41 2022] GET /identity/v3/role_assignments?user.id=86a5ea803d59463f98f9da7b5281d7fb&scope.system=all&role.id=5070a00cc59d4fb184e8235488c81f16 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:42.029389 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cc5d-102e-4337-80ec-c8e7ccb64685 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:42.029843 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cc5d-102e-4337-80ec-c8e7ccb64685 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:42.030267 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cc5d-102e-4337-80ec-c8e7ccb64685 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:42.031984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 176/360] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:42.032990 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080cc5d-102e-4337-80ec-c8e7ccb64685 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:42.100034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:42.117804 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:42.122178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681eb78-3b30-4121-8f19-1aba4860d032 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:42.177394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f2b95-9b5d-4253-93fb-9099a1771747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:42.179074 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2b95-9b5d-4253-93fb-9099a1771747 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:42.179801 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2b95-9b5d-4253-93fb-9099a1771747 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:42.180258 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2b95-9b5d-4253-93fb-9099a1771747 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:42.189812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080cc5d-102e-4337-80ec-c8e7ccb64685 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:42.196716 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f2b95-9b5d-4253-93fb-9099a1771747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c82f2b95-9b5d-4253-93fb-9099a1771747 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:42.205410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:42.206335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:42.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 185/361] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:42.207838 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f2b95-9b5d-4253-93fb-9099a1771747 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:42.239247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87570a6b-764f-406d-99ee-1e118cbf009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:42.240602 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87570a6b-764f-406d-99ee-1e118cbf009c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:42.240712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87570a6b-764f-406d-99ee-1e118cbf009c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:42.242026 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87570a6b-764f-406d-99ee-1e118cbf009c None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:42.243329 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87570a6b-764f-406d-99ee-1e118cbf009c None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:42.244847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87570a6b-764f-406d-99ee-1e118cbf009c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:42.246709 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 177/362] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:42 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:42.247700 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db65f-abcc-4855-b4d4-20445d15a1da None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:42.247985 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db65f-abcc-4855-b4d4-20445d15a1da None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:42.248263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db65f-abcc-4855-b4d4-20445d15a1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:42.277409 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-fb8db65f-abcc-4855-b4d4-20445d15a1da None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:42.278911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fb8db65f-abcc-4855-b4d4-20445d15a1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:42.349127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f2b95-9b5d-4253-93fb-9099a1771747 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:42.365285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 178/363] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:42.366338 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8db65f-abcc-4855-b4d4-20445d15a1da None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:42.392309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b7f52-08f7-42a9-b956-99db2821a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:42.393260 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b7f52-08f7-42a9-b956-99db2821a457 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:42.393551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b7f52-08f7-42a9-b956-99db2821a457 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:42.393938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b7f52-08f7-42a9-b956-99db2821a457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:42.415943 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:42.435000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:42.485977 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b7f52-08f7-42a9-b956-99db2821a457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:42.488581 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b7f52-08f7-42a9-b956-99db2821a457 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:42.499967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8db65f-abcc-4855-b4d4-20445d15a1da None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:42.555849 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b9d2f-9480-4d40-af1e-0b80f9dee524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:42.556571 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9d2f-9480-4d40-af1e-0b80f9dee524 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:42.556852 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9d2f-9480-4d40-af1e-0b80f9dee524 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:42.557175 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9d2f-9480-4d40-af1e-0b80f9dee524 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:42.557926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b9d2f-9480-4d40-af1e-0b80f9dee524 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:42.558229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b9d2f-9480-4d40-af1e-0b80f9dee524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:42.559594 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b9d2f-9480-4d40-af1e-0b80f9dee524 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:42.571171 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 179/364] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:42.571827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b9d2f-9480-4d40-af1e-0b80f9dee524 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:42.617401 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 186/365] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:42.619456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b7f52-08f7-42a9-b956-99db2821a457 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:42.687419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:42.705308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b9d2f-9480-4d40-af1e-0b80f9dee524 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:42.708212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:42.743454 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b7f52-08f7-42a9-b956-99db2821a457 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:42.748931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4dc39-84e6-40ed-af75-6da973fc34e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:42.750060 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4dc39-84e6-40ed-af75-6da973fc34e5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:42.750548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4dc39-84e6-40ed-af75-6da973fc34e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:42.751018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4dc39-84e6-40ed-af75-6da973fc34e5 None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:42.752420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4dc39-84e6-40ed-af75-6da973fc34e5 None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:42.753986 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4dc39-84e6-40ed-af75-6da973fc34e5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:42.760556 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 180/366] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:42 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:42.761428 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4dc39-84e6-40ed-af75-6da973fc34e5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:42.784613 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012e348-ecff-481b-b475-dce18a941efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:42.785445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e348-ecff-481b-b475-dce18a941efb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:42.787306 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e348-ecff-481b-b475-dce18a941efb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:42.787306 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e348-ecff-481b-b475-dce18a941efb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:42.802876 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012e348-ecff-481b-b475-dce18a941efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-f012e348-ecff-481b-b475-dce18a941efb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:42.810656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:42.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:42.812402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 187/367] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:01:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:42.813146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012e348-ecff-481b-b475-dce18a941efb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:42.895409 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4dc39-84e6-40ed-af75-6da973fc34e5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:42.940175 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9959221-db70-4190-aa13-056b91f57d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:42.941156 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959221-db70-4190-aa13-056b91f57d32 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:42.941442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959221-db70-4190-aa13-056b91f57d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:42.941720 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959221-db70-4190-aa13-056b91f57d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:42.946727 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012e348-ecff-481b-b475-dce18a941efb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:42.966284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:42.990088 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3723653-fff1-487a-bc9a-9bb19344eb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:42.990970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3723653-fff1-487a-bc9a-9bb19344eb26 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:42.991254 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3723653-fff1-487a-bc9a-9bb19344eb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:42.991532 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3723653-fff1-487a-bc9a-9bb19344eb26 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:42.992773 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3723653-fff1-487a-bc9a-9bb19344eb26 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:42.994319 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3723653-fff1-487a-bc9a-9bb19344eb26 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:42.996317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 188/368] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:42 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:43.001974 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3723653-fff1-487a-bc9a-9bb19344eb26 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:43.003289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:43.045186 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9959221-db70-4190-aa13-056b91f57d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:43.046653 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9959221-db70-4190-aa13-056b91f57d32 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:43.114399 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3723653-fff1-487a-bc9a-9bb19344eb26 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:43.167768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36a463-8073-4501-86c2-80e6b5727d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:43.169181 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a463-8073-4501-86c2-80e6b5727d1c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:43.169303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a463-8073-4501-86c2-80e6b5727d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:43.169841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a463-8073-4501-86c2-80e6b5727d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:43.170699 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36a463-8073-4501-86c2-80e6b5727d1c None admin] RBAC: Adding query filter params (group.id=c1069df7a1bb4dbe965322f28bd04199, role.id=14df33950256418dae713180ece879af, scope.project.id=6055d4c138374609abba19bcdd29bb97) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:43.171515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36a463-8073-4501-86c2-80e6b5727d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:43.172454 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36a463-8073-4501-86c2-80e6b5727d1c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:43.175286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 181/369] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:43.175908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9959221-db70-4190-aa13-056b91f57d32 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:43.187731 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 189/370] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 10:01:42 2022] GET /identity/v3/role_assignments?group.id=c1069df7a1bb4dbe965322f28bd04199&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=14df33950256418dae713180ece879af => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:43.188563 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36a463-8073-4501-86c2-80e6b5727d1c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:43.256642 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:43.322369 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:43.347239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36a463-8073-4501-86c2-80e6b5727d1c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:43.369301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9959221-db70-4190-aa13-056b91f57d32 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:43.400393 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758f618-4edc-4db0-b62d-0f8b480efc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:43.401661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f618-4edc-4db0-b62d-0f8b480efc4d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:43.402156 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f618-4edc-4db0-b62d-0f8b480efc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:43.402650 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f618-4edc-4db0-b62d-0f8b480efc4d None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:43.404058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758f618-4edc-4db0-b62d-0f8b480efc4d None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:43.405747 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758f618-4edc-4db0-b62d-0f8b480efc4d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:43.408267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 190/371] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:43 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:43.409661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758f618-4edc-4db0-b62d-0f8b480efc4d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:43.412368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2139b2-95de-4251-8c7c-879453336277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:43.413076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2139b2-95de-4251-8c7c-879453336277 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:43.413362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2139b2-95de-4251-8c7c-879453336277 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:43.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2139b2-95de-4251-8c7c-879453336277 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:43.414771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2139b2-95de-4251-8c7c-879453336277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:43.415090 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2139b2-95de-4251-8c7c-879453336277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:43.416589 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2139b2-95de-4251-8c7c-879453336277 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:43.426453 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 182/372] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:43.427355 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2139b2-95de-4251-8c7c-879453336277 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:43.518782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758f618-4edc-4db0-b62d-0f8b480efc4d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:43.538381 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:43.540992 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2139b2-95de-4251-8c7c-879453336277 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:43.558980 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab2264-1db8-42a6-93dd-bb00ccb657b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:43.560222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2264-1db8-42a6-93dd-bb00ccb657b3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:43.560713 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2264-1db8-42a6-93dd-bb00ccb657b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:43.561218 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2264-1db8-42a6-93dd-bb00ccb657b3 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:43.562685 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab2264-1db8-42a6-93dd-bb00ccb657b3 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:43.564361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab2264-1db8-42a6-93dd-bb00ccb657b3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:43.567290 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 191/373] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:43 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:43.568269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab2264-1db8-42a6-93dd-bb00ccb657b3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:43.579951 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:43.588850 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e4c8c-12c4-4b10-a2f9-75da8ae6ce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:43.589528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e4c8c-12c4-4b10-a2f9-75da8ae6ce65 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:43.589820 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e4c8c-12c4-4b10-a2f9-75da8ae6ce65 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:43.590101 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e4c8c-12c4-4b10-a2f9-75da8ae6ce65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:43.590947 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e4c8c-12c4-4b10-a2f9-75da8ae6ce65 None admin] RBAC: Adding query filter params (group.id=c1069df7a1bb4dbe965322f28bd04199, role.id=14df33950256418dae713180ece879af, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:43.591263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e4c8c-12c4-4b10-a2f9-75da8ae6ce65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:43.593194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e4c8c-12c4-4b10-a2f9-75da8ae6ce65 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:43.599834 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 183/374] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 10:01:43 2022] GET /identity/v3/role_assignments?group.id=c1069df7a1bb4dbe965322f28bd04199&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=14df33950256418dae713180ece879af => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:43.600669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e4c8c-12c4-4b10-a2f9-75da8ae6ce65 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:43.684937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab2264-1db8-42a6-93dd-bb00ccb657b3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:43.718260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e4c8c-12c4-4b10-a2f9-75da8ae6ce65 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:43.723535 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd695d8e-6078-4f29-be10-ed17838cefc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:43.724492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd695d8e-6078-4f29-be10-ed17838cefc3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:43.725027 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd695d8e-6078-4f29-be10-ed17838cefc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:43.725510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd695d8e-6078-4f29-be10-ed17838cefc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:43.757602 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010213b1-1a4b-4193-b14d-86f1f221c726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:43.758449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010213b1-1a4b-4193-b14d-86f1f221c726 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:43.758777 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010213b1-1a4b-4193-b14d-86f1f221c726 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:43.759064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010213b1-1a4b-4193-b14d-86f1f221c726 None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:43.761326 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010213b1-1a4b-4193-b14d-86f1f221c726 None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:43.762769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010213b1-1a4b-4193-b14d-86f1f221c726 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:43.764509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 184/375] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:43 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:43.771010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010213b1-1a4b-4193-b14d-86f1f221c726 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:43.789350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:43.805453 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd695d8e-6078-4f29-be10-ed17838cefc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:43.807289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd695d8e-6078-4f29-be10-ed17838cefc3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:43.845361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:43.888363 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010213b1-1a4b-4193-b14d-86f1f221c726 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:43.913927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 192/376] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:43.920014 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd695d8e-6078-4f29-be10-ed17838cefc3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:43.944944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719acc0d-c6d8-437c-b7b7-5a48dbae1056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:43.945551 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719acc0d-c6d8-437c-b7b7-5a48dbae1056 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:43.945839 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719acc0d-c6d8-437c-b7b7-5a48dbae1056 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:43.946118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719acc0d-c6d8-437c-b7b7-5a48dbae1056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:43.946965 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719acc0d-c6d8-437c-b7b7-5a48dbae1056 None admin] RBAC: Adding query filter params (group.id=c1069df7a1bb4dbe965322f28bd04199, role.id=a11101f17a5c44e5b5454f2f8af57cf3, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:43.947278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719acc0d-c6d8-437c-b7b7-5a48dbae1056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:43.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719acc0d-c6d8-437c-b7b7-5a48dbae1056 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:43.962637 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 185/377] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 10:01:43 2022] GET /identity/v3/role_assignments?group.id=c1069df7a1bb4dbe965322f28bd04199&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=a11101f17a5c44e5b5454f2f8af57cf3 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:43.987806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f874ca8-5852-415f-a208-27f181408544 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:43.988110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f874ca8-5852-415f-a208-27f181408544 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:43.988365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f874ca8-5852-415f-a208-27f181408544 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:43.990099 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 186/378] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:43.995585 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125c4f-f47f-4a9d-b326-30ddb8ba0ca3 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:43.995881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125c4f-f47f-4a9d-b326-30ddb8ba0ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:43.996150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125c4f-f47f-4a9d-b326-30ddb8ba0ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:44.014848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-77125c4f-f47f-4a9d-b326-30ddb8ba0ca3 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:44.016215 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-77125c4f-f47f-4a9d-b326-30ddb8ba0ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:44.026441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:44.045053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd695d8e-6078-4f29-be10-ed17838cefc3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:44.122691 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3455c-06d0-41aa-96bf-f27bd425d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:44.123980 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3455c-06d0-41aa-96bf-f27bd425d03a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:44.126305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3455c-06d0-41aa-96bf-f27bd425d03a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:44.126841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3455c-06d0-41aa-96bf-f27bd425d03a None admin] PATH_INFO: `/v3/projects/67c453797fe3453cabef5a606e310eef` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:44.130720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3455c-06d0-41aa-96bf-f27bd425d03a None admin] RBAC: Authorizing `identity:get_project(project_id=67c453797fe3453cabef5a606e310eef)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:44.132581 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3455c-06d0-41aa-96bf-f27bd425d03a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:44.136407 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 193/379] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:43 2022] GET /identity/v3/projects/67c453797fe3453cabef5a606e310eef => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:44.142417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3455c-06d0-41aa-96bf-f27bd425d03a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:44.152351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 187/380] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:44.183454 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77125c4f-f47f-4a9d-b326-30ddb8ba0ca3 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:44.253251 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:44.342891 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77125c4f-f47f-4a9d-b326-30ddb8ba0ca3 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:44.349504 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3455c-06d0-41aa-96bf-f27bd425d03a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:44.416471 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb82aa4-c81d-45d9-8396-0d8dae3defc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:44.417322 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb82aa4-c81d-45d9-8396-0d8dae3defc2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:44.417609 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb82aa4-c81d-45d9-8396-0d8dae3defc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:44.417890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb82aa4-c81d-45d9-8396-0d8dae3defc2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:44.420530 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20ba17-169d-4d92-8d5f-2221936d8c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:44.421427 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20ba17-169d-4d92-8d5f-2221936d8c71 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:44.421716 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20ba17-169d-4d92-8d5f-2221936d8c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:44.422003 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20ba17-169d-4d92-8d5f-2221936d8c71 None admin] PATH_INFO: `/v3/groups/6dde6ed3f4bd4a42acdbf622da0391d8` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:44.433887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20ba17-169d-4d92-8d5f-2221936d8c71 None admin] RBAC: Authorizing `identity:get_group(group_id=6dde6ed3f4bd4a42acdbf622da0391d8)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:44.435365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20ba17-169d-4d92-8d5f-2221936d8c71 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:44.437130 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 194/381] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:44 2022] GET /identity/v3/groups/6dde6ed3f4bd4a42acdbf622da0391d8 => generated 229 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:44.440249 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb82aa4-c81d-45d9-8396-0d8dae3defc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-2cb82aa4-c81d-45d9-8396-0d8dae3defc2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:44.448617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:44.449526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:44.450291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:44.450895 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20ba17-169d-4d92-8d5f-2221936d8c71 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:44.457233 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 188/382] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:44.458252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb82aa4-c81d-45d9-8396-0d8dae3defc2 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:44.477776 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:44.581915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb82aa4-c81d-45d9-8396-0d8dae3defc2 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:44.609252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:44.619434 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c2b07-817a-4330-b1b0-d5ee729dd37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:44.623863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2b07-817a-4330-b1b0-d5ee729dd37f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:44.625407 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2b07-817a-4330-b1b0-d5ee729dd37f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:44.625725 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2b07-817a-4330-b1b0-d5ee729dd37f None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:44.626804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c2b07-817a-4330-b1b0-d5ee729dd37f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:44.627123 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c2b07-817a-4330-b1b0-d5ee729dd37f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:44.629018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c2b07-817a-4330-b1b0-d5ee729dd37f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:44.650859 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 189/383] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:44.656915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c2b07-817a-4330-b1b0-d5ee729dd37f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:44.665398 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20ba17-169d-4d92-8d5f-2221936d8c71 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:44.769508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c2b07-817a-4330-b1b0-d5ee729dd37f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:44.796338 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93ad40-99e6-4b8c-a7de-4b9689bc1664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:44.797045 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ad40-99e6-4b8c-a7de-4b9689bc1664 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:44.797336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ad40-99e6-4b8c-a7de-4b9689bc1664 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:44.797621 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ad40-99e6-4b8c-a7de-4b9689bc1664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:44.798458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93ad40-99e6-4b8c-a7de-4b9689bc1664 None admin] RBAC: Adding query filter params (group.id=6dde6ed3f4bd4a42acdbf622da0391d8, role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=67c453797fe3453cabef5a606e310eef) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:44.798774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93ad40-99e6-4b8c-a7de-4b9689bc1664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:44.800214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93ad40-99e6-4b8c-a7de-4b9689bc1664 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:44.812748 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 195/384] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 10:01:44 2022] GET /identity/v3/role_assignments?group.id=6dde6ed3f4bd4a42acdbf622da0391d8&scope.project.id=67c453797fe3453cabef5a606e310eef&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 260 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:44.817798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fba13f-c7c1-41b4-b79f-f40e7af81115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:44.818767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba13f-c7c1-41b4-b79f-f40e7af81115 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:44.819048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba13f-c7c1-41b4-b79f-f40e7af81115 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:44.819327 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba13f-c7c1-41b4-b79f-f40e7af81115 None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:44.824028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fba13f-c7c1-41b4-b79f-f40e7af81115 None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:44.825584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fba13f-c7c1-41b4-b79f-f40e7af81115 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:44.827787 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 190/385] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:44 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:44.834071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93ad40-99e6-4b8c-a7de-4b9689bc1664 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:44.966453 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:44.991947 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93ad40-99e6-4b8c-a7de-4b9689bc1664 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:45.037102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0ce0-aae0-4831-bd6c-ca3b72112a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:45.038007 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0ce0-aae0-4831-bd6c-ca3b72112a16 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:45.038289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0ce0-aae0-4831-bd6c-ca3b72112a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:45.038565 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0ce0-aae0-4831-bd6c-ca3b72112a16 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:45.045844 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b0ce0-aae0-4831-bd6c-ca3b72112a16 None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:45.047321 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b0ce0-aae0-4831-bd6c-ca3b72112a16 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:45.049475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 196/386] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:44 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:45.055507 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fba13f-c7c1-41b4-b79f-f40e7af81115 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:45.127692 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:45.208774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fba13f-c7c1-41b4-b79f-f40e7af81115 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:45.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f2a9c-abac-4e14-9298-6ec9bbbed39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:45.249292 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f2a9c-abac-4e14-9298-6ec9bbbed39c None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:45.249576 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f2a9c-abac-4e14-9298-6ec9bbbed39c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:45.249853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f2a9c-abac-4e14-9298-6ec9bbbed39c None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97/groups/c1069df7a1bb4dbe965322f28bd04199/roles/a11101f17a5c44e5b5454f2f8af57cf3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:45.253003 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f2a9c-abac-4e14-9298-6ec9bbbed39c None admin] RBAC: Authorizing `identity:create_grant(project_id=6055d4c138374609abba19bcdd29bb97, group_id=c1069df7a1bb4dbe965322f28bd04199, role_id=a11101f17a5c44e5b5454f2f8af57cf3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:45.254530 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f2a9c-abac-4e14-9298-6ec9bbbed39c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:45.285957 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 191/387] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Jul 5 10:01:45 2022] PUT /identity/v3/projects/6055d4c138374609abba19bcdd29bb97/groups/c1069df7a1bb4dbe965322f28bd04199/roles/a11101f17a5c44e5b5454f2f8af57cf3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:45.758720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53c84c-bdbe-416a-b88f-2abdfce54398 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:45.759240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53c84c-bdbe-416a-b88f-2abdfce54398 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:45.759743 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53c84c-bdbe-416a-b88f-2abdfce54398 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:45.761598 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 197/388] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:45.766500 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be6108-35c3-46c3-bb3e-784cf19e97d8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:45.767000 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be6108-35c3-46c3-bb3e-784cf19e97d8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:45.767487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be6108-35c3-46c3-bb3e-784cf19e97d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:45.789873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-58be6108-35c3-46c3-bb3e-784cf19e97d8 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:45.791849 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-58be6108-35c3-46c3-bb3e-784cf19e97d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:45.874255 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 192/389] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:45.905633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53c84c-bdbe-416a-b88f-2abdfce54398 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:46.042494 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53c84c-bdbe-416a-b88f-2abdfce54398 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:46.098533 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcb62f-faac-4829-ba29-e2e9af535cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:46.099729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcb62f-faac-4829-ba29-e2e9af535cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:46.100229 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcb62f-faac-4829-ba29-e2e9af535cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:46.100700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcb62f-faac-4829-ba29-e2e9af535cd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:46.116622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcb62f-faac-4829-ba29-e2e9af535cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-32fcb62f-faac-4829-ba29-e2e9af535cd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:46.124516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:46.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:46.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:46.128483 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 198/390] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:46.135102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be6108-35c3-46c3-bb3e-784cf19e97d8 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:46.183798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:46.196575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a204-9f40-4be7-9cc9-fac617d8c801 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:46.196915 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a204-9f40-4be7-9cc9-fac617d8c801 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:46.197173 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a204-9f40-4be7-9cc9-fac617d8c801 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:46.199054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 199/391] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:46.206365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d8dda-c9e8-44ef-85a5-6b63f3046653 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:46.206647 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d8dda-c9e8-44ef-85a5-6b63f3046653 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:46.207088 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d8dda-c9e8-44ef-85a5-6b63f3046653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:46.241895 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-076d8dda-c9e8-44ef-85a5-6b63f3046653 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:46.243335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-076d8dda-c9e8-44ef-85a5-6b63f3046653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:46.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:46.255724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be6108-35c3-46c3-bb3e-784cf19e97d8 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:46.329664 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585649a9-8ed3-495f-9a24-9bd52cced414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:46.330358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585649a9-8ed3-495f-9a24-9bd52cced414 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:46.330649 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585649a9-8ed3-495f-9a24-9bd52cced414 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:46.330932 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585649a9-8ed3-495f-9a24-9bd52cced414 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:46.331696 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585649a9-8ed3-495f-9a24-9bd52cced414 None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:46.332015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585649a9-8ed3-495f-9a24-9bd52cced414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:46.333663 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585649a9-8ed3-495f-9a24-9bd52cced414 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:46.337332 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 200/392] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:46.351652 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 193/393] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:46.356866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d8dda-c9e8-44ef-85a5-6b63f3046653 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:46.368179 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585649a9-8ed3-495f-9a24-9bd52cced414 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:46.483053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d8dda-c9e8-44ef-85a5-6b63f3046653 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:46.490823 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:46.495644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585649a9-8ed3-495f-9a24-9bd52cced414 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:46.526448 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3c2e8-3d4e-4599-937b-2f3c3f2c4d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:46.527529 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3c2e8-3d4e-4599-937b-2f3c3f2c4d1d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:46.527983 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3c2e8-3d4e-4599-937b-2f3c3f2c4d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:46.528397 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3c2e8-3d4e-4599-937b-2f3c3f2c4d1d None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:46.529712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3c2e8-3d4e-4599-937b-2f3c3f2c4d1d None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:46.531302 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3c2e8-3d4e-4599-937b-2f3c3f2c4d1d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:46.533376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 201/394] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:46 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:46.534861 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534512-3e4d-4674-b983-6bb93a6e0031 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:46.535343 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534512-3e4d-4674-b983-6bb93a6e0031 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:46.535852 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534512-3e4d-4674-b983-6bb93a6e0031 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:46.537793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 202/395] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:46.538749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0534512-3e4d-4674-b983-6bb93a6e0031 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:46.548127 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9a975-8aef-4082-bf77-e157daf6be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:46.549177 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9a975-8aef-4082-bf77-e157daf6be38 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:46.549609 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9a975-8aef-4082-bf77-e157daf6be38 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:46.550060 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9a975-8aef-4082-bf77-e157daf6be38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:46.550439 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:46.564157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9a975-8aef-4082-bf77-e157daf6be38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-4db9a975-8aef-4082-bf77-e157daf6be38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:46.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:46.579783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:46.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:46.583371 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 194/396] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:46.584871 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ea403-fa55-4dbb-8071-7513a891c949 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:46.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ea403-fa55-4dbb-8071-7513a891c949 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:46.585848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ea403-fa55-4dbb-8071-7513a891c949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:46.606425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-0d3ea403-fa55-4dbb-8071-7513a891c949 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:46.608217 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0d3ea403-fa55-4dbb-8071-7513a891c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:46.648105 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0534512-3e4d-4674-b983-6bb93a6e0031 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:46.686927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09e35f-4242-40eb-bf5a-a82b1244be27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:46.687803 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09e35f-4242-40eb-bf5a-a82b1244be27 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:46.688086 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09e35f-4242-40eb-bf5a-a82b1244be27 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:46.688359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09e35f-4242-40eb-bf5a-a82b1244be27 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:46.689821 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09e35f-4242-40eb-bf5a-a82b1244be27 None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:46.696917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 195/397] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:46.696917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ea403-fa55-4dbb-8071-7513a891c949 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:46.697944 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09e35f-4242-40eb-bf5a-a82b1244be27 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:46.700817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 203/398] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:46 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:46.707220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09e35f-4242-40eb-bf5a-a82b1244be27 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:46.789081 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:46.818562 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09e35f-4242-40eb-bf5a-a82b1244be27 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:46.830035 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:46.846432 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ea403-fa55-4dbb-8071-7513a891c949 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:46.859059 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde5c28-d9f3-428a-b443-1dcb9e7f16c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:46.859954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde5c28-d9f3-428a-b443-1dcb9e7f16c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:46.860395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde5c28-d9f3-428a-b443-1dcb9e7f16c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:46.860832 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde5c28-d9f3-428a-b443-1dcb9e7f16c7 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97/groups/c1069df7a1bb4dbe965322f28bd04199/roles/14df33950256418dae713180ece879af` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:46.862986 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde5c28-d9f3-428a-b443-1dcb9e7f16c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6055d4c138374609abba19bcdd29bb97, group_id=c1069df7a1bb4dbe965322f28bd04199, role_id=14df33950256418dae713180ece879af)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:46.865231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde5c28-d9f3-428a-b443-1dcb9e7f16c7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:46.882132 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 204/399] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Jul 5 10:01:46 2022] PUT /identity/v3/projects/6055d4c138374609abba19bcdd29bb97/groups/c1069df7a1bb4dbe965322f28bd04199/roles/14df33950256418dae713180ece879af => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:46.883289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde5c28-d9f3-428a-b443-1dcb9e7f16c7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:46.892000 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619af4de-3435-4767-8d8c-3dd238aebd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:46.897863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af4de-3435-4767-8d8c-3dd238aebd23 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:46.898153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af4de-3435-4767-8d8c-3dd238aebd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:46.898432 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af4de-3435-4767-8d8c-3dd238aebd23 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:46.899237 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619af4de-3435-4767-8d8c-3dd238aebd23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:46.899538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619af4de-3435-4767-8d8c-3dd238aebd23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:46.901076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619af4de-3435-4767-8d8c-3dd238aebd23 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:46.929362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 196/400] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:46.934863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619af4de-3435-4767-8d8c-3dd238aebd23 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:47.069435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde5c28-d9f3-428a-b443-1dcb9e7f16c7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:47.080691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619af4de-3435-4767-8d8c-3dd238aebd23 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:47.115415 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964a432-037b-4782-8f9c-2b52ab2385fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:47.116241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a432-037b-4782-8f9c-2b52ab2385fd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.116569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a432-037b-4782-8f9c-2b52ab2385fd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.116846 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a432-037b-4782-8f9c-2b52ab2385fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.122254 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:47.130205 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a38c11-fc13-4010-8826-8fca60d23442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:47.131412 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a38c11-fc13-4010-8826-8fca60d23442 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.131900 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a38c11-fc13-4010-8826-8fca60d23442 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.132005 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964a432-037b-4782-8f9c-2b52ab2385fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:47.132469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a38c11-fc13-4010-8826-8fca60d23442 None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.134094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a38c11-fc13-4010-8826-8fca60d23442 None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:47.135757 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a38c11-fc13-4010-8826-8fca60d23442 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:47.138037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 197/401] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:46 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4964a432-037b-4782-8f9c-2b52ab2385fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:47.140855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:47.142026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:47.142964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:47.144741 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a38c11-fc13-4010-8826-8fca60d23442 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:47.147096 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 205/402] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:47.152529 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964a432-037b-4782-8f9c-2b52ab2385fd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:47.173347 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:47.253269 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a38c11-fc13-4010-8826-8fca60d23442 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:47.288842 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580434-e682-4192-9389-5b4bdd9a6407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:47.290014 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580434-e682-4192-9389-5b4bdd9a6407 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.290469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580434-e682-4192-9389-5b4bdd9a6407 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.290899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580434-e682-4192-9389-5b4bdd9a6407 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.292293 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580434-e682-4192-9389-5b4bdd9a6407 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:47.294396 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580434-e682-4192-9389-5b4bdd9a6407 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:47.296683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 198/403] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:47 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:47.303029 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580434-e682-4192-9389-5b4bdd9a6407 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:47.382901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964a432-037b-4782-8f9c-2b52ab2385fd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:47.406525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:47.420371 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580434-e682-4192-9389-5b4bdd9a6407 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:47.434993 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1172db-9ddb-46b9-b0cf-ab8b7caa66b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:47.435891 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1172db-9ddb-46b9-b0cf-ab8b7caa66b3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.436010 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1172db-9ddb-46b9-b0cf-ab8b7caa66b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.436211 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1172db-9ddb-46b9-b0cf-ab8b7caa66b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.436986 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1172db-9ddb-46b9-b0cf-ab8b7caa66b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:47.437296 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1172db-9ddb-46b9-b0cf-ab8b7caa66b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:47.444920 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1172db-9ddb-46b9-b0cf-ab8b7caa66b3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:47.447608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 206/404] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:47.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89649a3-ddea-4bcd-b4a0-25e4f5a8af30 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.452720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89649a3-ddea-4bcd-b4a0-25e4f5a8af30 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.453099 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89649a3-ddea-4bcd-b4a0-25e4f5a8af30 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.454679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 207/405] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:47.455449 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89649a3-ddea-4bcd-b4a0-25e4f5a8af30 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:47.479818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daefe90-4e1a-4bac-acae-3551169b450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:47.480717 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daefe90-4e1a-4bac-acae-3551169b450a None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daefe90-4e1a-4bac-acae-3551169b450a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.481322 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daefe90-4e1a-4bac-acae-3551169b450a None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/groups/c1069df7a1bb4dbe965322f28bd04199/roles/14df33950256418dae713180ece879af` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.483426 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daefe90-4e1a-4bac-acae-3551169b450a None admin] RBAC: Authorizing `identity:create_grant(project_id=575de2d42ac04a449b44cc054a2e5b2c, group_id=c1069df7a1bb4dbe965322f28bd04199, role_id=14df33950256418dae713180ece879af)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:47.485105 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daefe90-4e1a-4bac-acae-3551169b450a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:47.502611 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 199/406] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Jul 5 10:01:47 2022] PUT /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/groups/c1069df7a1bb4dbe965322f28bd04199/roles/14df33950256418dae713180ece879af => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:47.509790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84352535-692a-4a3c-8ed8-95854aa338c3 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.510126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84352535-692a-4a3c-8ed8-95854aa338c3 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.510410 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84352535-692a-4a3c-8ed8-95854aa338c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.533395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:47.542137 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-84352535-692a-4a3c-8ed8-95854aa338c3 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:47.543395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-84352535-692a-4a3c-8ed8-95854aa338c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:47.573835 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89649a3-ddea-4bcd-b4a0-25e4f5a8af30 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:47.612159 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54e59c-c409-4bbd-9789-de7b328218e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:47.613171 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e59c-c409-4bbd-9789-de7b328218e2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.613564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e59c-c409-4bbd-9789-de7b328218e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.613932 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e59c-c409-4bbd-9789-de7b328218e2 None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.615332 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54e59c-c409-4bbd-9789-de7b328218e2 None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:47.616942 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54e59c-c409-4bbd-9789-de7b328218e2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:47.618789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 208/407] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:47 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:47.624614 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54e59c-c409-4bbd-9789-de7b328218e2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:47.713313 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 200/408] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:47.738152 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84352535-692a-4a3c-8ed8-95854aa338c3 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:47.741703 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54e59c-c409-4bbd-9789-de7b328218e2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:47.767964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:47.779947 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fe071-badd-48df-866c-7e279c20f078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:47.780812 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fe071-badd-48df-866c-7e279c20f078 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.781126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fe071-badd-48df-866c-7e279c20f078 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.781405 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fe071-badd-48df-866c-7e279c20f078 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.783596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fe071-badd-48df-866c-7e279c20f078 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:47.785058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fe071-badd-48df-866c-7e279c20f078 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:47.787150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 209/409] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:47 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:47.792756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fe071-badd-48df-866c-7e279c20f078 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:47.840558 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:47.869584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84352535-692a-4a3c-8ed8-95854aa338c3 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:47.895113 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fe071-badd-48df-866c-7e279c20f078 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:47.907667 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc3f36-d7ec-42f8-8dc0-d0d5d7b391b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:47.908825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc3f36-d7ec-42f8-8dc0-d0d5d7b391b6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.909272 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc3f36-d7ec-42f8-8dc0-d0d5d7b391b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.909711 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc3f36-d7ec-42f8-8dc0-d0d5d7b391b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.921510 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc3f36-d7ec-42f8-8dc0-d0d5d7b391b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-22bc3f36-d7ec-42f8-8dc0-d0d5d7b391b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:47.930616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:47.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:47.932612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:47.934362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 201/410] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:01:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:47.938858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003bb94-a7b0-43cc-b95c-528c36185dcf None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.938858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003bb94-a7b0-43cc-b95c-528c36185dcf None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.938858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003bb94-a7b0-43cc-b95c-528c36185dcf None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.938858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 202/411] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:47.941162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003bb94-a7b0-43cc-b95c-528c36185dcf None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:47.943628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702139d-5cab-4454-a0f2-72f283005efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:47.944771 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702139d-5cab-4454-a0f2-72f283005efe None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.945284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702139d-5cab-4454-a0f2-72f283005efe None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.945782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702139d-5cab-4454-a0f2-72f283005efe None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/groups/c1069df7a1bb4dbe965322f28bd04199/roles/a11101f17a5c44e5b5454f2f8af57cf3` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.948267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702139d-5cab-4454-a0f2-72f283005efe None admin] RBAC: Authorizing `identity:create_grant(project_id=575de2d42ac04a449b44cc054a2e5b2c, group_id=c1069df7a1bb4dbe965322f28bd04199, role_id=a11101f17a5c44e5b5454f2f8af57cf3)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:47.950008 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702139d-5cab-4454-a0f2-72f283005efe None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:47.965393 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 210/412] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Jul 5 10:01:47 2022] PUT /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c/groups/c1069df7a1bb4dbe965322f28bd04199/roles/a11101f17a5c44e5b5454f2f8af57cf3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:01:47.967088 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9b98-63de-4b0a-83ca-a4356a11acc3 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:47.967691 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9b98-63de-4b0a-83ca-a4356a11acc3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:47.968186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9b98-63de-4b0a-83ca-a4356a11acc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:47.989425 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-43de9b98-63de-4b0a-83ca-a4356a11acc3 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:47.991050 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-43de9b98-63de-4b0a-83ca-a4356a11acc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:48.053694 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:48.077245 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 211/413] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:48.106103 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de9b98-63de-4b0a-83ca-a4356a11acc3 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:48.112445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003bb94-a7b0-43cc-b95c-528c36185dcf None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:48.178449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7502a1-a956-44eb-96f2-a12298999c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:48.180356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7502a1-a956-44eb-96f2-a12298999c79 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:48.180356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7502a1-a956-44eb-96f2-a12298999c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:48.180356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7502a1-a956-44eb-96f2-a12298999c79 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:48.180593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7502a1-a956-44eb-96f2-a12298999c79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:48.180761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7502a1-a956-44eb-96f2-a12298999c79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:48.182570 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7502a1-a956-44eb-96f2-a12298999c79 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:48.192977 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:48.197869 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 203/414] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:48.205727 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7502a1-a956-44eb-96f2-a12298999c79 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:48.255951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de9b98-63de-4b0a-83ca-a4356a11acc3 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:48.293060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496692f-a8ae-466b-9191-231883ddfe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:48.294456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496692f-a8ae-466b-9191-231883ddfe2c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:48.294895 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496692f-a8ae-466b-9191-231883ddfe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:48.295319 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496692f-a8ae-466b-9191-231883ddfe2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:48.308325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496692f-a8ae-466b-9191-231883ddfe2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4496692f-a8ae-466b-9191-231883ddfe2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:48.323080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:48.324071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:48.324837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 212/415] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:48.330541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496692f-a8ae-466b-9191-231883ddfe2c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:48.334060 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7502a1-a956-44eb-96f2-a12298999c79 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:48.400330 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69269093-bbc3-4170-8016-a22d217a4ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:48.401223 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69269093-bbc3-4170-8016-a22d217a4ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:48.401508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69269093-bbc3-4170-8016-a22d217a4ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:48.401788 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69269093-bbc3-4170-8016-a22d217a4ec4 None admin] PATH_INFO: `/v3/groups/6dde6ed3f4bd4a42acdbf622da0391d8` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:48.403773 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69269093-bbc3-4170-8016-a22d217a4ec4 None admin] RBAC: Authorizing `identity:get_group(group_id=6dde6ed3f4bd4a42acdbf622da0391d8)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:48.409383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69269093-bbc3-4170-8016-a22d217a4ec4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:48.412109 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 204/416] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:48 2022] GET /identity/v3/groups/6dde6ed3f4bd4a42acdbf622da0391d8 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:48.419359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69269093-bbc3-4170-8016-a22d217a4ec4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:48.427938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:48.533890 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496692f-a8ae-466b-9191-231883ddfe2c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:48.540566 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:48.604339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69269093-bbc3-4170-8016-a22d217a4ec4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:48.606497 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef35376-837c-4f02-840d-d896bb384032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:48.607177 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35376-837c-4f02-840d-d896bb384032 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:48.607465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35376-837c-4f02-840d-d896bb384032 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:48.607763 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef35376-837c-4f02-840d-d896bb384032 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:48.608498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef35376-837c-4f02-840d-d896bb384032 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:48.608810 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef35376-837c-4f02-840d-d896bb384032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:48.610242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef35376-837c-4f02-840d-d896bb384032 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:48.621027 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 213/417] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:48.630419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef35376-837c-4f02-840d-d896bb384032 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:48.671594 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b9a4a-f5ac-4fb1-b761-df65b42fd744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:48.672474 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b9a4a-f5ac-4fb1-b761-df65b42fd744 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:48.672765 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b9a4a-f5ac-4fb1-b761-df65b42fd744 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:48.673069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b9a4a-f5ac-4fb1-b761-df65b42fd744 None admin] PATH_INFO: `/v3/projects/67c453797fe3453cabef5a606e310eef` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:48.677668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b9a4a-f5ac-4fb1-b761-df65b42fd744 None admin] RBAC: Authorizing `identity:get_project(project_id=67c453797fe3453cabef5a606e310eef)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:48.679127 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b9a4a-f5ac-4fb1-b761-df65b42fd744 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:48.681051 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 205/418] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:48 2022] GET /identity/v3/projects/67c453797fe3453cabef5a606e310eef => generated 344 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:48.686344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b9a4a-f5ac-4fb1-b761-df65b42fd744 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:48.796437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef35376-837c-4f02-840d-d896bb384032 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:48.811902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b9a4a-f5ac-4fb1-b761-df65b42fd744 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:48.813250 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:48.853693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825736bf-4e01-4883-a705-a9fd7dbc959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:48.854698 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825736bf-4e01-4883-a705-a9fd7dbc959d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:48.855190 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825736bf-4e01-4883-a705-a9fd7dbc959d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:48.855730 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825736bf-4e01-4883-a705-a9fd7dbc959d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:48.877087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d928c-fb39-44ab-808b-1d06b530c7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:48.878659 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d928c-fb39-44ab-808b-1d06b530c7a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:48.879177 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d928c-fb39-44ab-808b-1d06b530c7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:48.879671 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d928c-fb39-44ab-808b-1d06b530c7a3 None admin] PATH_INFO: `/v3/projects/67c453797fe3453cabef5a606e310eef/groups/6dde6ed3f4bd4a42acdbf622da0391d8/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:48.881978 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d928c-fb39-44ab-808b-1d06b530c7a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=67c453797fe3453cabef5a606e310eef, group_id=6dde6ed3f4bd4a42acdbf622da0391d8, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:48.883692 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d928c-fb39-44ab-808b-1d06b530c7a3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:48.893908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:48.908608 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 206/419] 10.222.0.13 () {58 vars in 1442 bytes} [Tue Jul 5 10:01:48 2022] PUT /identity/v3/projects/67c453797fe3453cabef5a606e310eef/groups/6dde6ed3f4bd4a42acdbf622da0391d8/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 10:01:48.964094 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825736bf-4e01-4883-a705-a9fd7dbc959d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:48.965773 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825736bf-4e01-4883-a705-a9fd7dbc959d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:49.111174 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 214/420] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:49.117401 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d928c-fb39-44ab-808b-1d06b530c7a3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:49.231503 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d928c-fb39-44ab-808b-1d06b530c7a3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:49.257541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e080a13-d427-4184-8625-5fa8edec1454 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:49.257853 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e080a13-d427-4184-8625-5fa8edec1454 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:49.258116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e080a13-d427-4184-8625-5fa8edec1454 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:49.260962 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 215/421] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:49.265933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ebc95-a65d-4272-9ea6-b56a5c7cd0ab None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:49.266226 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ebc95-a65d-4272-9ea6-b56a5c7cd0ab None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:49.266510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ebc95-a65d-4272-9ea6-b56a5c7cd0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:49.267458 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399a391-7d26-447d-890f-1c0b0622fd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:49.268323 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399a391-7d26-447d-890f-1c0b0622fd45 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:49.268607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399a391-7d26-447d-890f-1c0b0622fd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:49.269040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399a391-7d26-447d-890f-1c0b0622fd45 None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:49.270209 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399a391-7d26-447d-890f-1c0b0622fd45 None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:49.271668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399a391-7d26-447d-890f-1c0b0622fd45 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:49.276937 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 207/422] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:49 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:49.278840 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399a391-7d26-447d-890f-1c0b0622fd45 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:49.289251 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:49.306354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f64ebc95-a65d-4272-9ea6-b56a5c7cd0ab None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:49.307569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f64ebc95-a65d-4272-9ea6-b56a5c7cd0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:49.429483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:49.432223 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 216/423] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:49.458850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ebc95-a65d-4272-9ea6-b56a5c7cd0ab None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:49.499554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399a391-7d26-447d-890f-1c0b0622fd45 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:49.549161 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936c714-22d6-4b66-b31b-f0c663277879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:49.550034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936c714-22d6-4b66-b31b-f0c663277879 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:49.550317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936c714-22d6-4b66-b31b-f0c663277879 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:49.550598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936c714-22d6-4b66-b31b-f0c663277879 None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:49.556740 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936c714-22d6-4b66-b31b-f0c663277879 None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:49.556740 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936c714-22d6-4b66-b31b-f0c663277879 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:49.557163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 208/424] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:49 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:49.567586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936c714-22d6-4b66-b31b-f0c663277879 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:49.652741 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ebc95-a65d-4272-9ea6-b56a5c7cd0ab None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:49.689084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e837-2785-44fc-8ee2-224d0eb03ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:49.689808 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e837-2785-44fc-8ee2-224d0eb03ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:49.690088 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e837-2785-44fc-8ee2-224d0eb03ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:49.690360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e837-2785-44fc-8ee2-224d0eb03ec7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:49.693736 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:49.702070 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888e837-2785-44fc-8ee2-224d0eb03ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-f888e837-2785-44fc-8ee2-224d0eb03ec7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:49.710757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:49.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:49.712514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 217/425] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:49.726859 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e837-2785-44fc-8ee2-224d0eb03ec7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:49.769574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936c714-22d6-4b66-b31b-f0c663277879 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:49.830994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:49.839656 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47255f71-56dc-4061-b57d-1c6a1669f52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:49.840323 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255f71-56dc-4061-b57d-1c6a1669f52e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:49.840611 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255f71-56dc-4061-b57d-1c6a1669f52e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:49.840909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255f71-56dc-4061-b57d-1c6a1669f52e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:49.841761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47255f71-56dc-4061-b57d-1c6a1669f52e None admin] RBAC: Adding query filter params (group.id=c1069df7a1bb4dbe965322f28bd04199, role.id=a11101f17a5c44e5b5454f2f8af57cf3, scope.project.id=6055d4c138374609abba19bcdd29bb97) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:49.842079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47255f71-56dc-4061-b57d-1c6a1669f52e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:49.843772 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47255f71-56dc-4061-b57d-1c6a1669f52e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:49.851051 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 209/426] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 10:01:49 2022] GET /identity/v3/role_assignments?group.id=c1069df7a1bb4dbe965322f28bd04199&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=a11101f17a5c44e5b5454f2f8af57cf3 => generated 611 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:49.921003 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e837-2785-44fc-8ee2-224d0eb03ec7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:49.976234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7af95-9fb4-4360-8ca2-b40204aa2c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:49.976846 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7af95-9fb4-4360-8ca2-b40204aa2c47 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:49.977167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7af95-9fb4-4360-8ca2-b40204aa2c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:49.977451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7af95-9fb4-4360-8ca2-b40204aa2c47 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:49.978218 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7af95-9fb4-4360-8ca2-b40204aa2c47 None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:49.978534 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7af95-9fb4-4360-8ca2-b40204aa2c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:49.979953 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7af95-9fb4-4360-8ca2-b40204aa2c47 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:49.993639 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 218/427] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:49.999388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47255f71-56dc-4061-b57d-1c6a1669f52e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:50.107370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47255f71-56dc-4061-b57d-1c6a1669f52e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:50.145673 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daad5e-3081-4b69-a26f-9cb6371aaf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:50.146341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daad5e-3081-4b69-a26f-9cb6371aaf02 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:50.146629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daad5e-3081-4b69-a26f-9cb6371aaf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:50.146906 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daad5e-3081-4b69-a26f-9cb6371aaf02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:50.160417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f1639-b8d0-47c7-bc0b-93f14c9b640f None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:50.161063 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f1639-b8d0-47c7-bc0b-93f14c9b640f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:50.161063 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f1639-b8d0-47c7-bc0b-93f14c9b640f None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:50.162423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 219/428] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:50.173663 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d398f-81c3-42b5-a07b-7cd33d23216c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:50.174091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d398f-81c3-42b5-a07b-7cd33d23216c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:50.174483 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d398f-81c3-42b5-a07b-7cd33d23216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:50.200508 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f70d398f-81c3-42b5-a07b-7cd33d23216c None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:50.202467 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f70d398f-81c3-42b5-a07b-7cd33d23216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:50.230227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:50.241148 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daad5e-3081-4b69-a26f-9cb6371aaf02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:50.243354 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daad5e-3081-4b69-a26f-9cb6371aaf02 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:50.278604 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:50.312982 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 220/429] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:50.337410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d398f-81c3-42b5-a07b-7cd33d23216c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:50.392518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 210/430] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:50.393881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daad5e-3081-4b69-a26f-9cb6371aaf02 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:50.469704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d398f-81c3-42b5-a07b-7cd33d23216c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:50.516673 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:50.519026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746d595-cc62-40e8-a80a-20970c3e0671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:50.520383 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746d595-cc62-40e8-a80a-20970c3e0671 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:50.521632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746d595-cc62-40e8-a80a-20970c3e0671 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:50.522470 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746d595-cc62-40e8-a80a-20970c3e0671 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:50.524614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daad5e-3081-4b69-a26f-9cb6371aaf02 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:50.536405 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746d595-cc62-40e8-a80a-20970c3e0671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-6746d595-cc62-40e8-a80a-20970c3e0671 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:50.545599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:50.546502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 10:01:50.547278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:50.550276 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 221/431] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:50.557566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746d595-cc62-40e8-a80a-20970c3e0671 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:50.566445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92439198-8b2d-417b-bae4-0ef1ee87bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:50.567349 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92439198-8b2d-417b-bae4-0ef1ee87bb0b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:50.567637 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92439198-8b2d-417b-bae4-0ef1ee87bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:50.567920 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92439198-8b2d-417b-bae4-0ef1ee87bb0b None admin] PATH_INFO: `/v3/projects/6055d4c138374609abba19bcdd29bb97` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:50.569150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92439198-8b2d-417b-bae4-0ef1ee87bb0b None admin] RBAC: Authorizing `identity:get_project(project_id=6055d4c138374609abba19bcdd29bb97)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:50.570843 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92439198-8b2d-417b-bae4-0ef1ee87bb0b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:50.576764 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 211/432] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:50 2022] GET /identity/v3/projects/6055d4c138374609abba19bcdd29bb97 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:50.578041 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92439198-8b2d-417b-bae4-0ef1ee87bb0b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:50.624939 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:50.685059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92439198-8b2d-417b-bae4-0ef1ee87bb0b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:50.687494 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746d595-cc62-40e8-a80a-20970c3e0671 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:50.720360 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fa10f-cf53-42d9-b475-be43b66a09fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:50.721254 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fa10f-cf53-42d9-b475-be43b66a09fa None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:50.721544 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fa10f-cf53-42d9-b475-be43b66a09fa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:50.721824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fa10f-cf53-42d9-b475-be43b66a09fa None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:50.722677 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72086b-92f3-4d5d-9adf-9d591da8d29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:50.723537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fa10f-cf53-42d9-b475-be43b66a09fa None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:50.723989 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72086b-92f3-4d5d-9adf-9d591da8d29c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:50.724277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72086b-92f3-4d5d-9adf-9d591da8d29c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:50.724561 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72086b-92f3-4d5d-9adf-9d591da8d29c None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:50.725021 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fa10f-cf53-42d9-b475-be43b66a09fa None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:50.725339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72086b-92f3-4d5d-9adf-9d591da8d29c None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:50.725653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72086b-92f3-4d5d-9adf-9d591da8d29c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:50.729079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 212/433] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:50 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:50.729227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72086b-92f3-4d5d-9adf-9d591da8d29c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:50.729317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b879a5-4a9f-478a-8019-54eee0c5fafc None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:50.729317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b879a5-4a9f-478a-8019-54eee0c5fafc None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:50.729317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b879a5-4a9f-478a-8019-54eee0c5fafc None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:50.730000 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 213/434] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:50.732060 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b879a5-4a9f-478a-8019-54eee0c5fafc None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:50.737654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 222/435] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:01:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:50.739129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd8e52-ae47-4746-9df0-97c05016cbb6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:50.739426 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd8e52-ae47-4746-9df0-97c05016cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:50.739708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd8e52-ae47-4746-9df0-97c05016cbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:50.755726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b8bd8e52-ae47-4746-9df0-97c05016cbb6 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:50.756932 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b8bd8e52-ae47-4746-9df0-97c05016cbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:50.769572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:50.829675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 223/436] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:50.830519 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd8e52-ae47-4746-9df0-97c05016cbb6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:50.850992 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b879a5-4a9f-478a-8019-54eee0c5fafc None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:50.882371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:50.888754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5ea91-ee9f-467b-845f-d54ee267d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:50.889448 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ea91-ee9f-467b-845f-d54ee267d7ff None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:50.889731 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ea91-ee9f-467b-845f-d54ee267d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:50.890006 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ea91-ee9f-467b-845f-d54ee267d7ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:50.890840 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5ea91-ee9f-467b-845f-d54ee267d7ff None admin] RBAC: Adding query filter params (group.id=c1069df7a1bb4dbe965322f28bd04199, role.id=14df33950256418dae713180ece879af, scope.project.id=6055d4c138374609abba19bcdd29bb97) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:50.891150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5ea91-ee9f-467b-845f-d54ee267d7ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:50.892624 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5ea91-ee9f-467b-845f-d54ee267d7ff None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:50.899183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 214/437] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 10:01:50 2022] GET /identity/v3/role_assignments?group.id=c1069df7a1bb4dbe965322f28bd04199&scope.project.id=6055d4c138374609abba19bcdd29bb97&role.id=14df33950256418dae713180ece879af => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:50.899972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5ea91-ee9f-467b-845f-d54ee267d7ff None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:50.970114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd8e52-ae47-4746-9df0-97c05016cbb6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:51.014756 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:51.023070 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8cbf8-40a0-492c-aa32-474478304e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:51.023644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5ea91-ee9f-467b-845f-d54ee267d7ff None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:51.024230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8cbf8-40a0-492c-aa32-474478304e3e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.024695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8cbf8-40a0-492c-aa32-474478304e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.025203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8cbf8-40a0-492c-aa32-474478304e3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.063742 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5126cba-2877-4f99-b631-480896e524a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:51.064579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5126cba-2877-4f99-b631-480896e524a1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.064871 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5126cba-2877-4f99-b631-480896e524a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.065180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5126cba-2877-4f99-b631-480896e524a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.080673 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5126cba-2877-4f99-b631-480896e524a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f5126cba-2877-4f99-b631-480896e524a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:51.091201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:51.092088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:51.092915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 215/438] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:51.099058 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5126cba-2877-4f99-b631-480896e524a1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:51.125825 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8cbf8-40a0-492c-aa32-474478304e3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:51.127477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8cbf8-40a0-492c-aa32-474478304e3e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:51.187089 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:51.240524 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5126cba-2877-4f99-b631-480896e524a1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:51.265200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 224/439] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:51.271266 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8cbf8-40a0-492c-aa32-474478304e3e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:51.286449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a64b9-b931-4a5e-a636-4807a329a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:51.286449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a64b9-b931-4a5e-a636-4807a329a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.286449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a64b9-b931-4a5e-a636-4807a329a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.286449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a64b9-b931-4a5e-a636-4807a329a7d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.287204 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a64b9-b931-4a5e-a636-4807a329a7d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:51.287512 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a64b9-b931-4a5e-a636-4807a329a7d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:51.288880 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a64b9-b931-4a5e-a636-4807a329a7d4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:51.301382 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 216/440] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:51.307061 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb150-79b1-4d06-92c0-67064d4a4c4b None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.307061 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb150-79b1-4d06-92c0-67064d4a4c4b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.307061 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beb150-79b1-4d06-92c0-67064d4a4c4b None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.309027 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 217/441] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:51.309243 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beb150-79b1-4d06-92c0-67064d4a4c4b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:51.335927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:51.401795 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8cbf8-40a0-492c-aa32-474478304e3e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:51.439416 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beb150-79b1-4d06-92c0-67064d4a4c4b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:51.442611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68cf09-14a7-4c30-a8db-51de98105f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:51.443501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68cf09-14a7-4c30-a8db-51de98105f22 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.443787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68cf09-14a7-4c30-a8db-51de98105f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.444071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68cf09-14a7-4c30-a8db-51de98105f22 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.445322 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68cf09-14a7-4c30-a8db-51de98105f22 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:51.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68cf09-14a7-4c30-a8db-51de98105f22 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:51.448506 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 225/442] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:51 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:51.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5dd30-cd5f-4860-b213-aad1f81331df None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.450119 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5dd30-cd5f-4860-b213-aad1f81331df None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.450404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5dd30-cd5f-4860-b213-aad1f81331df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.467188 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a4e5dd30-cd5f-4860-b213-aad1f81331df None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:51.468392 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a4e5dd30-cd5f-4860-b213-aad1f81331df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:51.471529 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:51.486024 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f972ff-1d48-41cf-aee2-7e77bc202b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:51.486774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f972ff-1d48-41cf-aee2-7e77bc202b07 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.487058 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f972ff-1d48-41cf-aee2-7e77bc202b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.487333 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f972ff-1d48-41cf-aee2-7e77bc202b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.543493 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 226/443] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:51.544510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5dd30-cd5f-4860-b213-aad1f81331df None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:51.565820 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f972ff-1d48-41cf-aee2-7e77bc202b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:51.568197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f972ff-1d48-41cf-aee2-7e77bc202b07 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:51.585926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:51.641618 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5dd30-cd5f-4860-b213-aad1f81331df None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:51.665738 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 218/444] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:51.666433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f972ff-1d48-41cf-aee2-7e77bc202b07 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:51.678311 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929786b-2699-48e0-9ba6-416cb43a9be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:51.679182 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929786b-2699-48e0-9ba6-416cb43a9be1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.679465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929786b-2699-48e0-9ba6-416cb43a9be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.679735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929786b-2699-48e0-9ba6-416cb43a9be1 None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.680913 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929786b-2699-48e0-9ba6-416cb43a9be1 None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:51.682672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929786b-2699-48e0-9ba6-416cb43a9be1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:51.684437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 227/445] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:51 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:51.685059 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929786b-2699-48e0-9ba6-416cb43a9be1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:51.694711 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:51.767937 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f972ff-1d48-41cf-aee2-7e77bc202b07 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:51.783589 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929786b-2699-48e0-9ba6-416cb43a9be1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:51.784788 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:51.808237 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f9888-1d29-4847-b3d5-1e44ee8e0875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:51.808966 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f9888-1d29-4847-b3d5-1e44ee8e0875 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.809253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f9888-1d29-4847-b3d5-1e44ee8e0875 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.809528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f9888-1d29-4847-b3d5-1e44ee8e0875 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.818823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9477b1-cfec-4160-b700-be71cff7cbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:51.819684 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9477b1-cfec-4160-b700-be71cff7cbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.819966 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9477b1-cfec-4160-b700-be71cff7cbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.820051 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f9888-1d29-4847-b3d5-1e44ee8e0875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:51.820241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9477b1-cfec-4160-b700-be71cff7cbe0 None admin] PATH_INFO: `/v3/projects/575de2d42ac04a449b44cc054a2e5b2c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.821436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9477b1-cfec-4160-b700-be71cff7cbe0 None admin] RBAC: Authorizing `identity:get_project(project_id=575de2d42ac04a449b44cc054a2e5b2c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:51.822885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9477b1-cfec-4160-b700-be71cff7cbe0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:51.824573 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 228/446] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:51 2022] GET /identity/v3/projects/575de2d42ac04a449b44cc054a2e5b2c => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:51.825352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9477b1-cfec-4160-b700-be71cff7cbe0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-3b5f9888-1d29-4847-b3d5-1e44ee8e0875 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:51.827628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:51.828534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 219/447] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:01:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:51.830011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f9888-1d29-4847-b3d5-1e44ee8e0875 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:51.901725 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:51.927676 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f9888-1d29-4847-b3d5-1e44ee8e0875 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:51.932669 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9477b1-cfec-4160-b700-be71cff7cbe0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:51.959818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6b306-d979-4278-8e07-80fd34ff37cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:51.960659 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6b306-d979-4278-8e07-80fd34ff37cd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.960960 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6b306-d979-4278-8e07-80fd34ff37cd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.961234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6b306-d979-4278-8e07-80fd34ff37cd None admin] PATH_INFO: `/v3/groups/c1069df7a1bb4dbe965322f28bd04199` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.962389 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6b306-d979-4278-8e07-80fd34ff37cd None admin] RBAC: Authorizing `identity:get_group(group_id=c1069df7a1bb4dbe965322f28bd04199)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:51.963816 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6b306-d979-4278-8e07-80fd34ff37cd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:51.965199 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc447e1-5250-4b60-a518-406f0176e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:51.965456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 220/448] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:51 2022] GET /identity/v3/groups/c1069df7a1bb4dbe965322f28bd04199 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:51.965863 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc447e1-5250-4b60-a518-406f0176e8bd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:51.966153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc447e1-5250-4b60-a518-406f0176e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:51.966248 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6b306-d979-4278-8e07-80fd34ff37cd None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:51.966475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc447e1-5250-4b60-a518-406f0176e8bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:51.967261 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc447e1-5250-4b60-a518-406f0176e8bd None admin] RBAC: Adding query filter params (group.id=c1069df7a1bb4dbe965322f28bd04199, role.id=14df33950256418dae713180ece879af, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:51.967577 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc447e1-5250-4b60-a518-406f0176e8bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:51.969022 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc447e1-5250-4b60-a518-406f0176e8bd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:51.976525 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 229/449] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 10:01:51 2022] GET /identity/v3/role_assignments?group.id=c1069df7a1bb4dbe965322f28bd04199&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=14df33950256418dae713180ece879af => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:51.977190 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc447e1-5250-4b60-a518-406f0176e8bd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:52.023348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:52.086788 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6b306-d979-4278-8e07-80fd34ff37cd None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:52.097445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc447e1-5250-4b60-a518-406f0176e8bd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:52.123948 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8ca5d-ad6f-438a-94f5-ec05460884ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:52.124620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8ca5d-ad6f-438a-94f5-ec05460884ca None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:52.124926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8ca5d-ad6f-438a-94f5-ec05460884ca None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:52.125216 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8ca5d-ad6f-438a-94f5-ec05460884ca None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:52.125978 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8ca5d-ad6f-438a-94f5-ec05460884ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:52.126292 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8ca5d-ad6f-438a-94f5-ec05460884ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:52.127663 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8ca5d-ad6f-438a-94f5-ec05460884ca None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:52.135351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29812e0-3036-41ac-b27b-9c48e1690ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:52.136026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29812e0-3036-41ac-b27b-9c48e1690ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:52.136315 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29812e0-3036-41ac-b27b-9c48e1690ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:52.136594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29812e0-3036-41ac-b27b-9c48e1690ed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:52.137450 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29812e0-3036-41ac-b27b-9c48e1690ed9 None admin] RBAC: Adding query filter params (group.id=c1069df7a1bb4dbe965322f28bd04199, role.id=a11101f17a5c44e5b5454f2f8af57cf3, scope.project.id=575de2d42ac04a449b44cc054a2e5b2c) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:52.137768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29812e0-3036-41ac-b27b-9c48e1690ed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:52.138267 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 221/450] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:01:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:52.139219 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29812e0-3036-41ac-b27b-9c48e1690ed9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:52.144276 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8ca5d-ad6f-438a-94f5-ec05460884ca None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:52.146004 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 230/451] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 10:01:51 2022] GET /identity/v3/role_assignments?group.id=c1069df7a1bb4dbe965322f28bd04199&scope.project.id=575de2d42ac04a449b44cc054a2e5b2c&role.id=a11101f17a5c44e5b5454f2f8af57cf3 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:52.256696 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8ca5d-ad6f-438a-94f5-ec05460884ca None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:52.267118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:52.300202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be5433-79e3-493a-a4c7-0b87f327d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:52.300917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5433-79e3-493a-a4c7-0b87f327d819 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:52.301202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5433-79e3-493a-a4c7-0b87f327d819 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:52.301479 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5433-79e3-493a-a4c7-0b87f327d819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:52.373370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5433-79e3-493a-a4c7-0b87f327d819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:52.374750 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5433-79e3-493a-a4c7-0b87f327d819 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:52.471861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 222/452] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:01:52.477558 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29812e0-3036-41ac-b27b-9c48e1690ed9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:52.481099 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:52.578067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29812e0-3036-41ac-b27b-9c48e1690ed9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:52.610880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faeb2ee-79c0-417a-af40-af1ca393fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:52.611741 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeb2ee-79c0-417a-af40-af1ca393fb43 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:52.612029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeb2ee-79c0-417a-af40-af1ca393fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:52.612307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeb2ee-79c0-417a-af40-af1ca393fb43 None admin] PATH_INFO: `/v3/projects/67c453797fe3453cabef5a606e310eef` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:52.614098 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faeb2ee-79c0-417a-af40-af1ca393fb43 None admin] RBAC: Authorizing `identity:get_project(project_id=67c453797fe3453cabef5a606e310eef)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:52.615531 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faeb2ee-79c0-417a-af40-af1ca393fb43 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:52.617261 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 231/453] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:01:52 2022] GET /identity/v3/projects/67c453797fe3453cabef5a606e310eef => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:52.622874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be5433-79e3-493a-a4c7-0b87f327d819 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:52.632854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:52.716633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be5433-79e3-493a-a4c7-0b87f327d819 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:52.749477 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7fe84-2711-4b40-95f8-cd74a0535f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:52.750315 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7fe84-2711-4b40-95f8-cd74a0535f7a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:52.750597 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7fe84-2711-4b40-95f8-cd74a0535f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:52.750872 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7fe84-2711-4b40-95f8-cd74a0535f7a None admin] PATH_INFO: `/v3/groups/6dde6ed3f4bd4a42acdbf622da0391d8` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:52.752019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7fe84-2711-4b40-95f8-cd74a0535f7a None admin] RBAC: Authorizing `identity:get_group(group_id=6dde6ed3f4bd4a42acdbf622da0391d8)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:52.753471 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7fe84-2711-4b40-95f8-cd74a0535f7a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:52.755074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 223/454] 10.222.0.13 () {56 vars in 1180 bytes} [Tue Jul 5 10:01:52 2022] GET /identity/v3/groups/6dde6ed3f4bd4a42acdbf622da0391d8 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:52.760643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faeb2ee-79c0-417a-af40-af1ca393fb43 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:52.827918 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:52.858553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faeb2ee-79c0-417a-af40-af1ca393fb43 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:52.890401 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40197c3e-5344-4667-8d23-c69b164cbea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:52.890989 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197c3e-5344-4667-8d23-c69b164cbea1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:52.891275 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197c3e-5344-4667-8d23-c69b164cbea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:52.891557 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197c3e-5344-4667-8d23-c69b164cbea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:52.892375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40197c3e-5344-4667-8d23-c69b164cbea1 None admin] RBAC: Adding query filter params (group.id=6dde6ed3f4bd4a42acdbf622da0391d8, role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=67c453797fe3453cabef5a606e310eef) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:52.892691 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40197c3e-5344-4667-8d23-c69b164cbea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:52.894139 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40197c3e-5344-4667-8d23-c69b164cbea1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:52.899717 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 232/455] 10.222.0.13 () {56 vars in 1376 bytes} [Tue Jul 5 10:01:52 2022] GET /identity/v3/role_assignments?group.id=6dde6ed3f4bd4a42acdbf622da0391d8&scope.project.id=67c453797fe3453cabef5a606e310eef&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:55.232941 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b5031-269b-491b-9ea0-2f3e0a293942 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:55.233481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b5031-269b-491b-9ea0-2f3e0a293942 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:55.233556 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b5031-269b-491b-9ea0-2f3e0a293942 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:55.235132 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 224/456] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:55.241133 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce0ffd-e11d-47f3-8358-51b68e9d2119 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:55.241988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce0ffd-e11d-47f3-8358-51b68e9d2119 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:55.242471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce0ffd-e11d-47f3-8358-51b68e9d2119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:55.260493 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-11ce0ffd-e11d-47f3-8358-51b68e9d2119 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:55.266073 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-11ce0ffd-e11d-47f3-8358-51b68e9d2119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:55.355622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 233/457] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:55.398393 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b5031-269b-491b-9ea0-2f3e0a293942 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:55.481795 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe54b10-b43f-49fc-9f45-51df60e12ef9 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:55.482130 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe54b10-b43f-49fc-9f45-51df60e12ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:55.482371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe54b10-b43f-49fc-9f45-51df60e12ef9 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:55.484790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 234/458] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:55.489422 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5de25-9bf3-4bd8-ac45-38b648c7c77d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:55.489714 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5de25-9bf3-4bd8-ac45-38b648c7c77d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:55.489997 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5de25-9bf3-4bd8-ac45-38b648c7c77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:55.496223 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:55.529915 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-79c5de25-9bf3-4bd8-ac45-38b648c7c77d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:55.531437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-79c5de25-9bf3-4bd8-ac45-38b648c7c77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:55.533576 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b5031-269b-491b-9ea0-2f3e0a293942 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:55.586659 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41c846-2d2d-43dd-be35-36d8ce29bcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:55.588119 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41c846-2d2d-43dd-be35-36d8ce29bcaa None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:55.588610 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41c846-2d2d-43dd-be35-36d8ce29bcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:55.589143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41c846-2d2d-43dd-be35-36d8ce29bcaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:55.601390 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41c846-2d2d-43dd-be35-36d8ce29bcaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:55.603170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41c846-2d2d-43dd-be35-36d8ce29bcaa None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-fe41c846-2d2d-43dd-be35-36d8ce29bcaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:01:55.627527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:55.628417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:55.629290 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:01:55.629290 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:01:55.629290 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:55.629290 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:55.632409 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 225/459] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:55.638541 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41c846-2d2d-43dd-be35-36d8ce29bcaa None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:55.688260 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:55.706856 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 235/460] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:55.748725 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5de25-9bf3-4bd8-ac45-38b648c7c77d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:55.769855 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41c846-2d2d-43dd-be35-36d8ce29bcaa None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:55.806359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08222a-5d74-4f46-b3aa-ad13a5bc903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:55.807371 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08222a-5d74-4f46-b3aa-ad13a5bc903a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:55.807881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08222a-5d74-4f46-b3aa-ad13a5bc903a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:55.808359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08222a-5d74-4f46-b3aa-ad13a5bc903a None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:55.809344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08222a-5d74-4f46-b3aa-ad13a5bc903a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:55.809856 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08222a-5d74-4f46-b3aa-ad13a5bc903a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:55.811448 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08222a-5d74-4f46-b3aa-ad13a5bc903a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:55.813246 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:55.825396 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 226/461] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:01:55.827070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595918a-c563-4c22-9e13-d4aaa093f918 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:55.827566 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595918a-c563-4c22-9e13-d4aaa093f918 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:55.828062 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595918a-c563-4c22-9e13-d4aaa093f918 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:55.830079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 227/462] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:55.830981 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595918a-c563-4c22-9e13-d4aaa093f918 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:55.876550 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5de25-9bf3-4bd8-ac45-38b648c7c77d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:55.919607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a92f9-1693-4894-9540-d82ecfbab017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:55.920772 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a92f9-1693-4894-9540-d82ecfbab017 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:55.921309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a92f9-1693-4894-9540-d82ecfbab017 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:55.921803 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a92f9-1693-4894-9540-d82ecfbab017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:55.933831 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a92f9-1693-4894-9540-d82ecfbab017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:55.935835 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a92f9-1693-4894-9540-d82ecfbab017 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-642a92f9-1693-4894-9540-d82ecfbab017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:01:55.957445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:55.958455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:55.959492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:01:55.959492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:01:55.959492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:55.959492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:55.961323 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595918a-c563-4c22-9e13-d4aaa093f918 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:55.961660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 236/463] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:55.963020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef930-4950-45b6-abf8-49915c7035ec None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:55.963590 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef930-4950-45b6-abf8-49915c7035ec None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:55.963999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ef930-4950-45b6-abf8-49915c7035ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:55.985468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e56ef930-4950-45b6-abf8-49915c7035ec None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:55.986957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e56ef930-4950-45b6-abf8-49915c7035ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:56.011144 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da95edb-fa32-4dc1-be9c-24f48a77e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:56.012022 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95edb-fa32-4dc1-be9c-24f48a77e375 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.012369 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95edb-fa32-4dc1-be9c-24f48a77e375 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.012795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95edb-fa32-4dc1-be9c-24f48a77e375 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.013664 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da95edb-fa32-4dc1-be9c-24f48a77e375 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:56.015570 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da95edb-fa32-4dc1-be9c-24f48a77e375 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:56.038156 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:56.045286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 228/464] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:01:55 2022] POST /identity/v3/users => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:56.047008 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da95edb-fa32-4dc1-be9c-24f48a77e375 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:56.071507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 237/465] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:56.110172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ef930-4950-45b6-abf8-49915c7035ec None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:56.112008 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:56.199881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da95edb-fa32-4dc1-be9c-24f48a77e375 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:56.250077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce24d7-fcca-497b-98d5-1bb37bdb2eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:56.251460 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce24d7-fcca-497b-98d5-1bb37bdb2eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.251747 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce24d7-fcca-497b-98d5-1bb37bdb2eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.252022 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce24d7-fcca-497b-98d5-1bb37bdb2eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.252816 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce24d7-fcca-497b-98d5-1bb37bdb2eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:56.253134 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce24d7-fcca-497b-98d5-1bb37bdb2eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:56.255147 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce24d7-fcca-497b-98d5-1bb37bdb2eb3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:56.259811 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ef930-4950-45b6-abf8-49915c7035ec None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:56.270730 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 229/466] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:56.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c6c79-0ba6-41f8-a147-ed951dfb1b2b None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c6c79-0ba6-41f8-a147-ed951dfb1b2b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.273106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c6c79-0ba6-41f8-a147-ed951dfb1b2b None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.275866 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 230/467] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:56.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c6c79-0ba6-41f8-a147-ed951dfb1b2b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:56.306060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd97e25-25bb-499d-b19a-17594950e78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:56.306878 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd97e25-25bb-499d-b19a-17594950e78e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.307165 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd97e25-25bb-499d-b19a-17594950e78e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.307446 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd97e25-25bb-499d-b19a-17594950e78e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.319725 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd97e25-25bb-499d-b19a-17594950e78e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:56.321232 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd97e25-25bb-499d-b19a-17594950e78e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-5fd97e25-25bb-499d-b19a-17594950e78e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:01:56.342566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:56.343460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:56.344297 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:01:56.344297 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:01:56.344297 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:56.344297 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:56.344297 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 238/468] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:56.345523 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782b66-f649-4cca-8632-e3106f48aa41 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.345809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782b66-f649-4cca-8632-e3106f48aa41 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.346088 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782b66-f649-4cca-8632-e3106f48aa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.366426 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-35782b66-f649-4cca-8632-e3106f48aa41 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:56.368001 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-35782b66-f649-4cca-8632-e3106f48aa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:56.394024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:56.419739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c6c79-0ba6-41f8-a147-ed951dfb1b2b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:56.431874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:56.449007 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 239/469] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:56.449908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35782b66-f649-4cca-8632-e3106f48aa41 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:56.477291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4e920-bcb1-4a27-9935-ee9b6cc5ab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:56.477967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4e920-bcb1-4a27-9935-ee9b6cc5ab2b None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.478253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4e920-bcb1-4a27-9935-ee9b6cc5ab2b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.478532 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4e920-bcb1-4a27-9935-ee9b6cc5ab2b None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.479241 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4e920-bcb1-4a27-9935-ee9b6cc5ab2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:56.480696 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4e920-bcb1-4a27-9935-ee9b6cc5ab2b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:56.505134 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 231/470] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:01:56 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:56.506000 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4e920-bcb1-4a27-9935-ee9b6cc5ab2b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:56.634692 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35782b66-f649-4cca-8632-e3106f48aa41 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:56.706119 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4e920-bcb1-4a27-9935-ee9b6cc5ab2b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:56.714241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc95743-1305-4b30-a597-0728bef9eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:56.714922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc95743-1305-4b30-a597-0728bef9eec8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.715643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc95743-1305-4b30-a597-0728bef9eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.715928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc95743-1305-4b30-a597-0728bef9eec8 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.716661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc95743-1305-4b30-a597-0728bef9eec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:56.717036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc95743-1305-4b30-a597-0728bef9eec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:56.719290 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc95743-1305-4b30-a597-0728bef9eec8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:56.736225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 240/471] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:56.741532 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc95743-1305-4b30-a597-0728bef9eec8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:56.750488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83227c3-43b3-428e-8273-8abfea40a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:56.751791 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83227c3-43b3-428e-8273-8abfea40a44c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.752074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83227c3-43b3-428e-8273-8abfea40a44c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.752355 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83227c3-43b3-428e-8273-8abfea40a44c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.763925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:56.767948 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83227c3-43b3-428e-8273-8abfea40a44c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:56.770300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83227c3-43b3-428e-8273-8abfea40a44c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f83227c3-43b3-428e-8273-8abfea40a44c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:01:56.794867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:56.795755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:56.796589 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:01:56.796589 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:01:56.796589 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:56.796589 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:56.801453 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 232/472] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:56.803873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83227c3-43b3-428e-8273-8abfea40a44c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:56.824183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:56.869069 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc95743-1305-4b30-a597-0728bef9eec8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:56.914769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771069c-5ae0-465e-8b86-e9564479b373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:56.915626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771069c-5ae0-465e-8b86-e9564479b373 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.915918 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771069c-5ae0-465e-8b86-e9564479b373 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.916569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771069c-5ae0-465e-8b86-e9564479b373 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.917317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771069c-5ae0-465e-8b86-e9564479b373 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:56.918759 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771069c-5ae0-465e-8b86-e9564479b373 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:56.937134 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83227c3-43b3-428e-8273-8abfea40a44c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:56.951680 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 241/473] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:01:56 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:56.953046 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a3775-97ed-463b-a7c5-6f66b0c9c835 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.953344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a3775-97ed-463b-a7c5-6f66b0c9c835 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.953622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a3775-97ed-463b-a7c5-6f66b0c9c835 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.954921 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 242/474] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:56.960950 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d2988-aeb6-4064-bb61-37bc8c2e0254 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.961268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d2988-aeb6-4064-bb61-37bc8c2e0254 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.961504 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d2988-aeb6-4064-bb61-37bc8c2e0254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.980100 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6c7d2988-aeb6-4064-bb61-37bc8c2e0254 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:56.981360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6c7d2988-aeb6-4064-bb61-37bc8c2e0254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:56.991730 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c414c-e537-4480-90bf-c19da6e47f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:56.992445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c414c-e537-4480-90bf-c19da6e47f4c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:56.992739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c414c-e537-4480-90bf-c19da6e47f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:56.993057 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c414c-e537-4480-90bf-c19da6e47f4c None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:56.994249 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c414c-e537-4480-90bf-c19da6e47f4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:56.994576 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c414c-e537-4480-90bf-c19da6e47f4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:56.996655 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c414c-e537-4480-90bf-c19da6e47f4c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:57.017059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 233/475] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:57.020538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c414c-e537-4480-90bf-c19da6e47f4c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:57.063092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 243/476] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:01:57.086419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d2988-aeb6-4064-bb61-37bc8c2e0254 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:57.090491 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:57.114626 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:57.148556 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c414c-e537-4480-90bf-c19da6e47f4c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:57.185815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bae4c-5371-4122-9703-ecd86def4150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:57.186402 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bae4c-5371-4122-9703-ecd86def4150 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:57.186679 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bae4c-5371-4122-9703-ecd86def4150 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:57.186950 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bae4c-5371-4122-9703-ecd86def4150 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:57.187659 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bae4c-5371-4122-9703-ecd86def4150 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:57.189153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bae4c-5371-4122-9703-ecd86def4150 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:57.224710 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d2988-aeb6-4064-bb61-37bc8c2e0254 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:57.227324 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 234/477] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:01:57 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:01:57.281580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cc496-7b2e-45e2-8f35-16ad663dfe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:57.282289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc496-7b2e-45e2-8f35-16ad663dfe9a None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:57.282573 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc496-7b2e-45e2-8f35-16ad663dfe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:57.282850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc496-7b2e-45e2-8f35-16ad663dfe9a None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:57.283645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cc496-7b2e-45e2-8f35-16ad663dfe9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:57.285088 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cc496-7b2e-45e2-8f35-16ad663dfe9a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:57.301203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.sql.core [None req-8a2cc496-7b2e-45e2-8f35-16ad663dfe9a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 10:01:57.301203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 10:01:57.301203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [parameters: {'id': '47f2da2159c244028b6de07dd5960649', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 10:01:57.301203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80361) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-8a2cc496-7b2e-45e2-8f35-16ad663dfe9a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application conn.query(q) Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application result.read() Jul 05 10:01:57.319436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return ref.to_dict() Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 10:01:57.320345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application next(self.gen) Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application yield resource Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application next(self.gen) Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise self.value Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application session.commit() Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 10:01:57.321300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self.session.flush() Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application compat.raise_( Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 10:01:57.322169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 10:01:57.323029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application conn.query(q) Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application result.read() Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 10:01:57.325406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [parameters: {'id': '47f2da2159c244028b6de07dd5960649', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:57.327412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 10:01:57.329515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:57.334111 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 244/478] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Jul 5 10:01:57 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:57.339633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bae4c-5371-4122-9703-ecd86def4150 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:57.456300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bae4c-5371-4122-9703-ecd86def4150 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:57.484432 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:57.493927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5e577-a63f-47b3-bb9c-c2905e3d306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:57.494744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5e577-a63f-47b3-bb9c-c2905e3d306b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:57.495026 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5e577-a63f-47b3-bb9c-c2905e3d306b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:57.495300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5e577-a63f-47b3-bb9c-c2905e3d306b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:57.506068 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5e577-a63f-47b3-bb9c-c2905e3d306b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-15d5e577-a63f-47b3-bb9c-c2905e3d306b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:57.514482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:57.516311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:57.518207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 235/479] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:01:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:57.522485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cc496-7b2e-45e2-8f35-16ad663dfe9a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:57.606313 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:57.643139 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cc496-7b2e-45e2-8f35-16ad663dfe9a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:57.680525 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ef3a8-de0b-47a9-91d9-34498bf3a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:57.681365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ef3a8-de0b-47a9-91d9-34498bf3a311 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:57.681649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ef3a8-de0b-47a9-91d9-34498bf3a311 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:57.681924 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ef3a8-de0b-47a9-91d9-34498bf3a311 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:57.682670 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ef3a8-de0b-47a9-91d9-34498bf3a311 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:57.682976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ef3a8-de0b-47a9-91d9-34498bf3a311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:57.684334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ef3a8-de0b-47a9-91d9-34498bf3a311 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:57.693565 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 245/480] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:01:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:58.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8658-1eb1-42fa-a9e9-28d8abdf5b30 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:58.620869 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8658-1eb1-42fa-a9e9-28d8abdf5b30 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:58.620869 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8658-1eb1-42fa-a9e9-28d8abdf5b30 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:58.622537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 236/481] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:58.627607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc602e3-42e0-4b3d-83a7-d364a89794d2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:58.628015 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc602e3-42e0-4b3d-83a7-d364a89794d2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:58.628178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc602e3-42e0-4b3d-83a7-d364a89794d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:58.645485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-abc602e3-42e0-4b3d-83a7-d364a89794d2 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:58.646677 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-abc602e3-42e0-4b3d-83a7-d364a89794d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:58.734707 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 246/482] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:58.777510 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba8658-1eb1-42fa-a9e9-28d8abdf5b30 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:58.917601 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba8658-1eb1-42fa-a9e9-28d8abdf5b30 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:58.964270 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553a02e-b634-4519-bfaf-c3f43dd72734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:58.965090 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553a02e-b634-4519-bfaf-c3f43dd72734 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:58.965377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553a02e-b634-4519-bfaf-c3f43dd72734 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:58.965656 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553a02e-b634-4519-bfaf-c3f43dd72734 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:58.979062 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553a02e-b634-4519-bfaf-c3f43dd72734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-5553a02e-b634-4519-bfaf-c3f43dd72734 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:58.986924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:58.987808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:58.989150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 237/483] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:01:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:58.994843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc602e3-42e0-4b3d-83a7-d364a89794d2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:59.071820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:59.087015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ff19-d763-4cb7-9ca3-e1e7db5843db None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:59.087300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ff19-d763-4cb7-9ca3-e1e7db5843db None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:59.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ff19-d763-4cb7-9ca3-e1e7db5843db None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:59.089092 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 238/484] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:01:59.094237 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28840b-4926-484c-93ac-1fc586117c17 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:59.094541 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28840b-4926-484c-93ac-1fc586117c17 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:59.094809 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28840b-4926-484c-93ac-1fc586117c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:59.115895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6b28840b-4926-484c-93ac-1fc586117c17 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:59.117392 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6b28840b-4926-484c-93ac-1fc586117c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:59.159700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc602e3-42e0-4b3d-83a7-d364a89794d2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:59.166854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:59.196752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 239/485] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:59.219500 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28840b-4926-484c-93ac-1fc586117c17 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:59.250939 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfd56b-0043-48a9-87a6-ad0ce9cb0791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:59.251623 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfd56b-0043-48a9-87a6-ad0ce9cb0791 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:59.251909 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfd56b-0043-48a9-87a6-ad0ce9cb0791 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:59.252186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfd56b-0043-48a9-87a6-ad0ce9cb0791 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:59.252960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfd56b-0043-48a9-87a6-ad0ce9cb0791 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:59.253271 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfd56b-0043-48a9-87a6-ad0ce9cb0791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:59.254830 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfd56b-0043-48a9-87a6-ad0ce9cb0791 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:59.272727 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 247/486] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:01:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:59.281854 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfd56b-0043-48a9-87a6-ad0ce9cb0791 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:59.336207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28840b-4926-484c-93ac-1fc586117c17 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:59.372480 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfbca3-0134-467f-94db-16923d2d96c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:59.373314 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfbca3-0134-467f-94db-16923d2d96c4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:59.373602 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfbca3-0134-467f-94db-16923d2d96c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:59.373883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfbca3-0134-467f-94db-16923d2d96c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:59.386465 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfbca3-0134-467f-94db-16923d2d96c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f0bfbca3-0134-467f-94db-16923d2d96c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:01:59.396266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:59.398308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:59.399794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 240/487] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:01:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:59.406827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfbca3-0134-467f-94db-16923d2d96c4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:59.452284 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:59.520926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfbca3-0134-467f-94db-16923d2d96c4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:59.558040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151294a4-00b8-41db-8b8b-c5cd1a7f13c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:59.558715 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151294a4-00b8-41db-8b8b-c5cd1a7f13c9 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:59.559002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151294a4-00b8-41db-8b8b-c5cd1a7f13c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:59.559319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151294a4-00b8-41db-8b8b-c5cd1a7f13c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:59.560348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151294a4-00b8-41db-8b8b-c5cd1a7f13c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:59.560662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151294a4-00b8-41db-8b8b-c5cd1a7f13c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:59.562281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151294a4-00b8-41db-8b8b-c5cd1a7f13c9 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:59.571408 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 241/488] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:01:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:59.576585 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151294a4-00b8-41db-8b8b-c5cd1a7f13c9 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:59.578852 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfd56b-0043-48a9-87a6-ad0ce9cb0791 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:59.619535 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:59.661662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb7a43-d482-4593-8ce8-283a5737a255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:59.662489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb7a43-d482-4593-8ce8-283a5737a255 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:59.662776 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb7a43-d482-4593-8ce8-283a5737a255 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:59.663058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb7a43-d482-4593-8ce8-283a5737a255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:59.687264 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb7a43-d482-4593-8ce8-283a5737a255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:59.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb7a43-d482-4593-8ce8-283a5737a255 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:59.689565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:59.693685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151294a4-00b8-41db-8b8b-c5cd1a7f13c9 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-57fb7a43-d482-4593-8ce8-283a5737a255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:01:59.713764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:59.714627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:59.715451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:01:59.715451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:01:59.715451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:59.715451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:01:59.715451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 248/489] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:01:59.717825 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1eb21-b97e-45de-887c-4df7cafd8285 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:59.717825 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1eb21-b97e-45de-887c-4df7cafd8285 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:59.721431 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1eb21-b97e-45de-887c-4df7cafd8285 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:59.723324 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 249/490] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:59.724041 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1eb21-b97e-45de-887c-4df7cafd8285 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:59.739649 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db5389-644f-4f55-9688-f75f6caf8916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:59.740663 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5389-644f-4f55-9688-f75f6caf8916 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:59.741369 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5389-644f-4f55-9688-f75f6caf8916 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:59.741709 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5389-644f-4f55-9688-f75f6caf8916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:59.755313 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db5389-644f-4f55-9688-f75f6caf8916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:59.756761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db5389-644f-4f55-9688-f75f6caf8916 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e3db5389-644f-4f55-9688-f75f6caf8916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:01:59.774211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:01:59.776166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:01:59.778285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:01:59.778285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:01:59.778285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:01:59.778285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:01:59.778285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 242/491] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:01:59.778285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04520322-333a-41e6-93ce-ab609261a629 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:59.778285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04520322-333a-41e6-93ce-ab609261a629 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:59.778285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04520322-333a-41e6-93ce-ab609261a629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:59.794606 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-04520322-333a-41e6-93ce-ab609261a629 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:01:59.795777 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-04520322-333a-41e6-93ce-ab609261a629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:01:59.834398 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1eb21-b97e-45de-887c-4df7cafd8285 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:01:59.870365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 243/492] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:01:59.870543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29096d-8477-4248-86d7-64609ceb7c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:01:59.870665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04520322-333a-41e6-93ce-ab609261a629 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:59.870740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29096d-8477-4248-86d7-64609ceb7c83 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:59.870740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29096d-8477-4248-86d7-64609ceb7c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:59.870740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29096d-8477-4248-86d7-64609ceb7c83 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:59.871258 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29096d-8477-4248-86d7-64609ceb7c83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:01:59.871742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29096d-8477-4248-86d7-64609ceb7c83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:01:59.873217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29096d-8477-4248-86d7-64609ceb7c83 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:01:59.888510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 250/493] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:01:59.890760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146a694-1c0b-4c88-9360-908de5f6fdb9 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:01:59.891227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146a694-1c0b-4c88-9360-908de5f6fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:01:59.891862 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146a694-1c0b-4c88-9360-908de5f6fdb9 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:01:59.893745 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 251/494] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:01:59.894636 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146a694-1c0b-4c88-9360-908de5f6fdb9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:01:59.934913 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:59.958665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:01:59.977143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04520322-333a-41e6-93ce-ab609261a629 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.006188 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146a694-1c0b-4c88-9360-908de5f6fdb9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.013037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880440c3-4fbc-4c11-a4ac-2716d359204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.013893 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880440c3-4fbc-4c11-a4ac-2716d359204f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.014010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880440c3-4fbc-4c11-a4ac-2716d359204f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.014258 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880440c3-4fbc-4c11-a4ac-2716d359204f None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.014979 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880440c3-4fbc-4c11-a4ac-2716d359204f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:00.015287 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880440c3-4fbc-4c11-a4ac-2716d359204f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:00.016694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880440c3-4fbc-4c11-a4ac-2716d359204f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:00.032325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 244/495] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:00.032325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880440c3-4fbc-4c11-a4ac-2716d359204f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:00.044624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b8bf-e64d-452f-adba-10e9898c5f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.045450 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b8bf-e64d-452f-adba-10e9898c5f2b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.045924 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b8bf-e64d-452f-adba-10e9898c5f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.046205 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b8bf-e64d-452f-adba-10e9898c5f2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.057071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187b8bf-e64d-452f-adba-10e9898c5f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-b187b8bf-e64d-452f-adba-10e9898c5f2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:00.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:00.065809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:00.067301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 252/496] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:01:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:00.068027 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1178df2-9d52-4929-bed7-e253ba1a843f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.068280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1178df2-9d52-4929-bed7-e253ba1a843f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.068559 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1178df2-9d52-4929-bed7-e253ba1a843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.089574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d1178df2-9d52-4929-bed7-e253ba1a843f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:00.090756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d1178df2-9d52-4929-bed7-e253ba1a843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:00.140306 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880440c3-4fbc-4c11-a4ac-2716d359204f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.162717 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 253/497] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:00.163912 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1178df2-9d52-4929-bed7-e253ba1a843f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:00.178839 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad7a86-2de4-47f8-bc3f-4722c029b7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.179769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad7a86-2de4-47f8-bc3f-4722c029b7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.180158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad7a86-2de4-47f8-bc3f-4722c029b7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.180538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad7a86-2de4-47f8-bc3f-4722c029b7b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.189071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad7a86-2de4-47f8-bc3f-4722c029b7b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:00.190995 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad7a86-2de4-47f8-bc3f-4722c029b7b3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:00.197883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e0ad7a86-2de4-47f8-bc3f-4722c029b7b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:00.207819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:00.208724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:00.209645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:00.209645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:00.209645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:00.209645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:00.209645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:00.209645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:00.209645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:00.209645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:00.209645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:00.209645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:00.209645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 245/498] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 10:02:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:00.210299 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad7a86-2de4-47f8-bc3f-4722c029b7b3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:00.213308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:00.287714 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1178df2-9d52-4929-bed7-e253ba1a843f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.321181 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad7a86-2de4-47f8-bc3f-4722c029b7b3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.324085 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4147887-d18f-4722-aad6-48481fe235c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.324229 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4147887-d18f-4722-aad6-48481fe235c0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.324426 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4147887-d18f-4722-aad6-48481fe235c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.324697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4147887-d18f-4722-aad6-48481fe235c0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.332265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4147887-d18f-4722-aad6-48481fe235c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:00.333547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4147887-d18f-4722-aad6-48481fe235c0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d4147887-d18f-4722-aad6-48481fe235c0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:00.351032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:00.351940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:00.352827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:00.352827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:00.352827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:00.352827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:00.352827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:00.352827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:00.352827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:00.352827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:00.352827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 10:02:00.352827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:00.352827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 254/499] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:00.354186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4147887-d18f-4722-aad6-48481fe235c0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:00.360601 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8021c-955e-4d42-b173-010f82a22e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.361301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8021c-955e-4d42-b173-010f82a22e27 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.361588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8021c-955e-4d42-b173-010f82a22e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.361865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8021c-955e-4d42-b173-010f82a22e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.362610 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8021c-955e-4d42-b173-010f82a22e27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:00.362916 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8021c-955e-4d42-b173-010f82a22e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:00.364834 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8021c-955e-4d42-b173-010f82a22e27 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:00.373374 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 246/500] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:00.378178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8021c-955e-4d42-b173-010f82a22e27 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:00.443601 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:00.446353 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:00.465238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4147887-d18f-4722-aad6-48481fe235c0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.484124 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8021c-955e-4d42-b173-010f82a22e27 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.502084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f084d9-2e6c-419c-bfdd-da8c84f8cf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.502898 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f084d9-2e6c-419c-bfdd-da8c84f8cf25 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.503186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f084d9-2e6c-419c-bfdd-da8c84f8cf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.503468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f084d9-2e6c-419c-bfdd-da8c84f8cf25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.513798 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f084d9-2e6c-419c-bfdd-da8c84f8cf25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:00.520125 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58d030-43f6-45dd-9519-5a3646ca3c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.520813 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58d030-43f6-45dd-9519-5a3646ca3c14 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.521120 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58d030-43f6-45dd-9519-5a3646ca3c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.521392 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58d030-43f6-45dd-9519-5a3646ca3c14 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d5f084d9-2e6c-419c-bfdd-da8c84f8cf25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:00.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:00.522960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:00.529277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:00.529895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58d030-43f6-45dd-9519-5a3646ca3c14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:00.529895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58d030-43f6-45dd-9519-5a3646ca3c14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:00.530017 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 255/501] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:00.530080 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58d030-43f6-45dd-9519-5a3646ca3c14 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:00.530143 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f084d9-2e6c-419c-bfdd-da8c84f8cf25 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:00.572111 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 247/502] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 10:02:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:00.572878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58d030-43f6-45dd-9519-5a3646ca3c14 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:00.634130 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f084d9-2e6c-419c-bfdd-da8c84f8cf25 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.670841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b125b0-9438-458d-8a88-8f9b3214a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.671508 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b125b0-9438-458d-8a88-8f9b3214a73a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.671792 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b125b0-9438-458d-8a88-8f9b3214a73a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.672067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b125b0-9438-458d-8a88-8f9b3214a73a None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.672909 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b125b0-9438-458d-8a88-8f9b3214a73a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:00.673223 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b125b0-9438-458d-8a88-8f9b3214a73a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:00.674661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b125b0-9438-458d-8a88-8f9b3214a73a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:00.682083 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58d030-43f6-45dd-9519-5a3646ca3c14 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.703911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:00.711502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 256/503] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 10:02:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:00.712242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b125b0-9438-458d-8a88-8f9b3214a73a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:00.715133 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:00.716648 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36235f11-6103-4eb1-87ec-806b6c226eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.717489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36235f11-6103-4eb1-87ec-806b6c226eef None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.717778 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36235f11-6103-4eb1-87ec-806b6c226eef None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.718050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36235f11-6103-4eb1-87ec-806b6c226eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.728535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36235f11-6103-4eb1-87ec-806b6c226eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:00.730036 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36235f11-6103-4eb1-87ec-806b6c226eef None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-36235f11-6103-4eb1-87ec-806b6c226eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:00.747271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:00.748164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:00.749032 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:00.749032 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:00.749032 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:00.749032 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:00.749032 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 248/504] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:00.749630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36235f11-6103-4eb1-87ec-806b6c226eef None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:00.811222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b125b0-9438-458d-8a88-8f9b3214a73a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.844731 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a08189-4a7f-4d8f-b8c7-cc6a25bbf17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.845364 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a08189-4a7f-4d8f-b8c7-cc6a25bbf17d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.845647 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a08189-4a7f-4d8f-b8c7-cc6a25bbf17d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.845932 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a08189-4a7f-4d8f-b8c7-cc6a25bbf17d None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.846664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a08189-4a7f-4d8f-b8c7-cc6a25bbf17d None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:00.846996 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a08189-4a7f-4d8f-b8c7-cc6a25bbf17d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:00.848879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a08189-4a7f-4d8f-b8c7-cc6a25bbf17d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:00.851878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36235f11-6103-4eb1-87ec-806b6c226eef None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.856602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 257/505] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:00.857829 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31addad-afc6-4085-a97d-a9007e0be9dc None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.858123 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31addad-afc6-4085-a97d-a9007e0be9dc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.858404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31addad-afc6-4085-a97d-a9007e0be9dc None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.859791 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 258/506] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:00.861652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31addad-afc6-4085-a97d-a9007e0be9dc None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:00.885321 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bc8b6-cbaa-4cb2-b5b4-553713f45750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.885966 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bc8b6-cbaa-4cb2-b5b4-553713f45750 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.886251 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bc8b6-cbaa-4cb2-b5b4-553713f45750 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.886534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bc8b6-cbaa-4cb2-b5b4-553713f45750 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:00.922263 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:00.928638 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:00.952926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bc8b6-cbaa-4cb2-b5b4-553713f45750 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:00.954402 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bc8b6-cbaa-4cb2-b5b4-553713f45750 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:00.960841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31addad-afc6-4085-a97d-a9007e0be9dc None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:00.993899 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda66256-ba61-4083-8f94-ad87a55e76af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:00.994554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66256-ba61-4083-8f94-ad87a55e76af None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:00.994829 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66256-ba61-4083-8f94-ad87a55e76af None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:00.995108 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66256-ba61-4083-8f94-ad87a55e76af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.049679 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 249/507] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:01.050505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bc8b6-cbaa-4cb2-b5b4-553713f45750 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:01.064677 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda66256-ba61-4083-8f94-ad87a55e76af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:01.066186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda66256-ba61-4083-8f94-ad87a55e76af None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:01.122661 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:01.124543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:01.150640 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bc8b6-cbaa-4cb2-b5b4-553713f45750 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:01.162193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 259/508] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:01.163013 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda66256-ba61-4083-8f94-ad87a55e76af None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:01.189552 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e097dc-d95d-43f6-822e-7cfa20f76561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:01.190212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e097dc-d95d-43f6-822e-7cfa20f76561 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:01.190493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e097dc-d95d-43f6-822e-7cfa20f76561 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:01.190767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e097dc-d95d-43f6-822e-7cfa20f76561 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.192026 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e097dc-d95d-43f6-822e-7cfa20f76561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:01.192334 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e097dc-d95d-43f6-822e-7cfa20f76561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:01.193739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e097dc-d95d-43f6-822e-7cfa20f76561 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:01.205016 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 250/509] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:01.206187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a8d9a-867d-4c05-960c-45827c7d6e82 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:01.206475 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a8d9a-867d-4c05-960c-45827c7d6e82 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:01.206753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a8d9a-867d-4c05-960c-45827c7d6e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.223423 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ca9a8d9a-867d-4c05-960c-45827c7d6e82 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:01.224631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ca9a8d9a-867d-4c05-960c-45827c7d6e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:01.260011 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda66256-ba61-4083-8f94-ad87a55e76af None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:01.289243 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 251/510] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:01.290383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a8d9a-867d-4c05-960c-45827c7d6e82 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:01.296788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04616aa8-aa9e-4cba-b5d7-2d56c0a9e18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:01.297104 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04616aa8-aa9e-4cba-b5d7-2d56c0a9e18a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:01.297389 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04616aa8-aa9e-4cba-b5d7-2d56c0a9e18a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:01.297774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04616aa8-aa9e-4cba-b5d7-2d56c0a9e18a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.308585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04616aa8-aa9e-4cba-b5d7-2d56c0a9e18a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:01.310063 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04616aa8-aa9e-4cba-b5d7-2d56c0a9e18a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-04616aa8-aa9e-4cba-b5d7-2d56c0a9e18a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:01.327871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:01.328887 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:01.329788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:01.329788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:01.329788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:01.329788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:01.329788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 260/511] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:01.330054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04616aa8-aa9e-4cba-b5d7-2d56c0a9e18a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:01.350800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:01.355915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:01.394342 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a8d9a-867d-4c05-960c-45827c7d6e82 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:01.427794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a003bd-52db-4958-8c9e-80446500a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:01.428585 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a003bd-52db-4958-8c9e-80446500a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:01.428867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a003bd-52db-4958-8c9e-80446500a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:01.429246 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a003bd-52db-4958-8c9e-80446500a4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.431094 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04616aa8-aa9e-4cba-b5d7-2d56c0a9e18a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:01.439465 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a003bd-52db-4958-8c9e-80446500a4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:01.440936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a003bd-52db-4958-8c9e-80446500a4d1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-a9a003bd-52db-4958-8c9e-80446500a4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:01.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:01.459762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:01.460598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:01.460598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:01.460598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:01.460598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:01.460598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 252/512] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:01.461220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a003bd-52db-4958-8c9e-80446500a4d1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:01.469570 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d614-51f3-4d5c-969e-56adff341400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:01.470372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d614-51f3-4d5c-969e-56adff341400 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:01.470656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d614-51f3-4d5c-969e-56adff341400 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:01.470933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d614-51f3-4d5c-969e-56adff341400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.481614 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4d614-51f3-4d5c-969e-56adff341400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:01.483086 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4d614-51f3-4d5c-969e-56adff341400 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-2fd4d614-51f3-4d5c-969e-56adff341400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:01.501109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:01.501999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:01.502827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:01.502827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:01.502827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:01.502827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:01.502827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 261/513] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:01.503095 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d614-51f3-4d5c-969e-56adff341400 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:01.563599 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a003bd-52db-4958-8c9e-80446500a4d1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:01.568647 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:01.579341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:01.597893 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1742d92-2a51-49b0-9308-0982726364b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:01.598683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1742d92-2a51-49b0-9308-0982726364b2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:01.598965 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1742d92-2a51-49b0-9308-0982726364b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:01.599246 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1742d92-2a51-49b0-9308-0982726364b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.601706 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d614-51f3-4d5c-969e-56adff341400 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:01.606701 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1742d92-2a51-49b0-9308-0982726364b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:01.608150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1742d92-2a51-49b0-9308-0982726364b2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f1742d92-2a51-49b0-9308-0982726364b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:01.622091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:01.622972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:01.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:01.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:01.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:01.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:01.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:01.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:01.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:01.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:01.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 10:02:01.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:01.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 253/514] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:01.624395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1742d92-2a51-49b0-9308-0982726364b2 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:01.636230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124963e-0807-4ed3-a1e8-b5c2685983af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:01.637055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124963e-0807-4ed3-a1e8-b5c2685983af None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:01.637342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124963e-0807-4ed3-a1e8-b5c2685983af None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:01.637617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124963e-0807-4ed3-a1e8-b5c2685983af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.649741 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124963e-0807-4ed3-a1e8-b5c2685983af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:01.651369 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124963e-0807-4ed3-a1e8-b5c2685983af None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d124963e-0807-4ed3-a1e8-b5c2685983af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:01.668183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:01.669312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:01.670497 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:01.670497 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:01.670497 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:01.670497 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:01.670497 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 262/515] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:01.670906 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124963e-0807-4ed3-a1e8-b5c2685983af None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:01.725522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1742d92-2a51-49b0-9308-0982726364b2 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:01.758328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ca470-0390-481e-bd00-1edacf880f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:01.758981 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ca470-0390-481e-bd00-1edacf880f9c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:01.759263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ca470-0390-481e-bd00-1edacf880f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:01.759542 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ca470-0390-481e-bd00-1edacf880f9c None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.760269 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ca470-0390-481e-bd00-1edacf880f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:01.760578 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ca470-0390-481e-bd00-1edacf880f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:01.761998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ca470-0390-481e-bd00-1edacf880f9c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:01.769112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124963e-0807-4ed3-a1e8-b5c2685983af None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:01.774577 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 254/516] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:01.775364 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ca470-0390-481e-bd00-1edacf880f9c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:01.791742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:01.806929 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfff59-8b2f-43b9-a989-3b4e418cb114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:01.807595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfff59-8b2f-43b9-a989-3b4e418cb114 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:01.807883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfff59-8b2f-43b9-a989-3b4e418cb114 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:01.808164 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfff59-8b2f-43b9-a989-3b4e418cb114 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.808880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfff59-8b2f-43b9-a989-3b4e418cb114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:01.809222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfff59-8b2f-43b9-a989-3b4e418cb114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:01.809407 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:01.810711 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfff59-8b2f-43b9-a989-3b4e418cb114 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:01.822294 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 263/517] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:01.825758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfff59-8b2f-43b9-a989-3b4e418cb114 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:01.872605 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ca470-0390-481e-bd00-1edacf880f9c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:01.904671 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a585fbd-e9c0-4579-acc1-50803bcdf401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:01.905291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a585fbd-e9c0-4579-acc1-50803bcdf401 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:01.905573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a585fbd-e9c0-4579-acc1-50803bcdf401 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:01.905856 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a585fbd-e9c0-4579-acc1-50803bcdf401 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.906558 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a585fbd-e9c0-4579-acc1-50803bcdf401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:01.906862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a585fbd-e9c0-4579-acc1-50803bcdf401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:01.908216 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a585fbd-e9c0-4579-acc1-50803bcdf401 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:01.919854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 255/518] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:01.920625 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a585fbd-e9c0-4579-acc1-50803bcdf401 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:01.922649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfff59-8b2f-43b9-a989-3b4e418cb114 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:01.956339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd176f-6009-42a1-ab60-ee10d050b386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:01.957547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd176f-6009-42a1-ab60-ee10d050b386 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:01.957836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd176f-6009-42a1-ab60-ee10d050b386 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:01.958114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd176f-6009-42a1-ab60-ee10d050b386 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:01.958940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd176f-6009-42a1-ab60-ee10d050b386 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:01.959255 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd176f-6009-42a1-ab60-ee10d050b386 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:01.960685 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd176f-6009-42a1-ab60-ee10d050b386 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:01.977610 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 264/519] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:01.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd176f-6009-42a1-ab60-ee10d050b386 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:02.010301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:02.016197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a585fbd-e9c0-4579-acc1-50803bcdf401 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:02.018164 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:02.049492 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9196ef8-648f-41a3-b085-a1dd41440f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:02.050152 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9196ef8-648f-41a3-b085-a1dd41440f70 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:02.050436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9196ef8-648f-41a3-b085-a1dd41440f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:02.050716 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9196ef8-648f-41a3-b085-a1dd41440f70 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:02.051431 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9196ef8-648f-41a3-b085-a1dd41440f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:02.051741 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9196ef8-648f-41a3-b085-a1dd41440f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:02.053145 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9196ef8-648f-41a3-b085-a1dd41440f70 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:02.064386 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 256/520] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:02.065343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9196ef8-648f-41a3-b085-a1dd41440f70 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:02.078894 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd176f-6009-42a1-ab60-ee10d050b386 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:02.112604 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c43aa-5434-49c6-88f3-35914f9cd11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:02.113510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c43aa-5434-49c6-88f3-35914f9cd11d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:02.113795 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c43aa-5434-49c6-88f3-35914f9cd11d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:02.114071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c43aa-5434-49c6-88f3-35914f9cd11d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:02.120955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c43aa-5434-49c6-88f3-35914f9cd11d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:02.122399 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c43aa-5434-49c6-88f3-35914f9cd11d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-bb3c43aa-5434-49c6-88f3-35914f9cd11d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:02.136988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:02.137874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:02.138739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:02.138739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:02.138739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:02.138739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:02.138739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:02.138739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:02.138739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:02.138739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:02.138739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 10:02:02.138739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:02.138739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 265/521] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:02.139416 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c43aa-5434-49c6-88f3-35914f9cd11d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:02.166843 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9196ef8-648f-41a3-b085-a1dd41440f70 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:02.200917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8b713-88ad-41a2-bdb4-798d9092c8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:02.201722 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8b713-88ad-41a2-bdb4-798d9092c8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:02.202000 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8b713-88ad-41a2-bdb4-798d9092c8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:02.202268 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8b713-88ad-41a2-bdb4-798d9092c8d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:02.208815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8b713-88ad-41a2-bdb4-798d9092c8d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:02.210261 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8b713-88ad-41a2-bdb4-798d9092c8d7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-38a8b713-88ad-41a2-bdb4-798d9092c8d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:02.224180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:02.225044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:02.225876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:02.225876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:02.225876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:02.225876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:02.225876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:02.225876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:02.225876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:02.225876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:02.225876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 257/522] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:02.226350 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8b713-88ad-41a2-bdb4-798d9092c8d7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:02.237197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:02.241808 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c43aa-5434-49c6-88f3-35914f9cd11d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:02.243896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:02.277118 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75123b18-e256-48e6-b32b-e45a63168265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:02.277907 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123b18-e256-48e6-b32b-e45a63168265 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:02.278192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123b18-e256-48e6-b32b-e45a63168265 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:02.278483 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123b18-e256-48e6-b32b-e45a63168265 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:02.284943 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75123b18-e256-48e6-b32b-e45a63168265 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:02.286936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75123b18-e256-48e6-b32b-e45a63168265 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-75123b18-e256-48e6-b32b-e45a63168265 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:02.301436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:02.302368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:02.303240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:02.303240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:02.303240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:02.303240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:02.303240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:02.303240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:02.303240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:02.303240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:02.303240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 266/523] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:02.303691 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75123b18-e256-48e6-b32b-e45a63168265 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:02.328042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8b713-88ad-41a2-bdb4-798d9092c8d7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:02.359988 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc2832-a78f-4a55-b0af-18a76ae2cfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:02.360626 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc2832-a78f-4a55-b0af-18a76ae2cfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:02.360983 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc2832-a78f-4a55-b0af-18a76ae2cfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:02.361265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc2832-a78f-4a55-b0af-18a76ae2cfe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:02.401219 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75123b18-e256-48e6-b32b-e45a63168265 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:02.426090 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc2832-a78f-4a55-b0af-18a76ae2cfe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:02.427493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc2832-a78f-4a55-b0af-18a76ae2cfe3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:02.434991 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c6ec9-fa39-4fdf-8a06-dd5bc6407b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:02.435660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6ec9-fa39-4fdf-8a06-dd5bc6407b2f None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:02.435940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6ec9-fa39-4fdf-8a06-dd5bc6407b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:02.436216 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6ec9-fa39-4fdf-8a06-dd5bc6407b2f None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:02.436934 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c6ec9-fa39-4fdf-8a06-dd5bc6407b2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:02.438372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c6ec9-fa39-4fdf-8a06-dd5bc6407b2f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:02.444047 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:02.458059 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 267/524] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:02:02 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:02.458853 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c6ec9-fa39-4fdf-8a06-dd5bc6407b2f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:02.475813 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:02.545371 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 258/525] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:02.546542 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc2832-a78f-4a55-b0af-18a76ae2cfe3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:02.578392 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c6ec9-fa39-4fdf-8a06-dd5bc6407b2f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:02.614839 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be4d3a-ab01-40d8-bba5-c99194ee3973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:02.615864 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be4d3a-ab01-40d8-bba5-c99194ee3973 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:02.616151 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be4d3a-ab01-40d8-bba5-c99194ee3973 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:02.616433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be4d3a-ab01-40d8-bba5-c99194ee3973 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:02.617301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be4d3a-ab01-40d8-bba5-c99194ee3973 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:02.617616 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be4d3a-ab01-40d8-bba5-c99194ee3973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:02.619039 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be4d3a-ab01-40d8-bba5-c99194ee3973 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:02.638223 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 268/526] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 10:02:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:02.639293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be4d3a-ab01-40d8-bba5-c99194ee3973 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:02.666168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc2832-a78f-4a55-b0af-18a76ae2cfe3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:02.684572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:02.705260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264e87f-6967-411e-b30b-1a3185d75014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:02.705922 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264e87f-6967-411e-b30b-1a3185d75014 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:02.706206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264e87f-6967-411e-b30b-1a3185d75014 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:02.706482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264e87f-6967-411e-b30b-1a3185d75014 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:02.707787 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264e87f-6967-411e-b30b-1a3185d75014 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:02.708087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264e87f-6967-411e-b30b-1a3185d75014 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:02.709625 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264e87f-6967-411e-b30b-1a3185d75014 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:02.716747 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:02.727674 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 259/527] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:02.728507 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264e87f-6967-411e-b30b-1a3185d75014 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:02.755411 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be4d3a-ab01-40d8-bba5-c99194ee3973 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:02.792107 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f159c-5243-4345-8677-ae22b919f73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:02.793129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f159c-5243-4345-8677-ae22b919f73d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:02.793709 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f159c-5243-4345-8677-ae22b919f73d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:02.794512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f159c-5243-4345-8677-ae22b919f73d None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:02.795305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f159c-5243-4345-8677-ae22b919f73d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:02.795619 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f159c-5243-4345-8677-ae22b919f73d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:02.797266 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f159c-5243-4345-8677-ae22b919f73d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:02.818555 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 269/528] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:02.819285 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f159c-5243-4345-8677-ae22b919f73d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:02.837830 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264e87f-6967-411e-b30b-1a3185d75014 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:02.873359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc17fc-cca5-4a28-8924-bd344a84cd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:02.874151 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc17fc-cca5-4a28-8924-bd344a84cd41 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:02.874433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc17fc-cca5-4a28-8924-bd344a84cd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:02.874703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc17fc-cca5-4a28-8924-bd344a84cd41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:02.885116 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc17fc-cca5-4a28-8924-bd344a84cd41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:02.886569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc17fc-cca5-4a28-8924-bd344a84cd41 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b6cc17fc-cca5-4a28-8924-bd344a84cd41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:02.904929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:02.905806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:02.906621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:02.906621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:02.906621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:02.906621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:02.906621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 260/529] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:02.906890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc17fc-cca5-4a28-8924-bd344a84cd41 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:02.928475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f159c-5243-4345-8677-ae22b919f73d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:02.939440 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:02.958854 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:02.964877 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31510f3-81b7-492d-bbe9-2eb0afced814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:02.965792 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31510f3-81b7-492d-bbe9-2eb0afced814 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:02.966279 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31510f3-81b7-492d-bbe9-2eb0afced814 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:02.966758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31510f3-81b7-492d-bbe9-2eb0afced814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:03.016625 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc17fc-cca5-4a28-8924-bd344a84cd41 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:03.038092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31510f3-81b7-492d-bbe9-2eb0afced814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:03.039843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31510f3-81b7-492d-bbe9-2eb0afced814 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:03.053612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629c0a2-f305-4417-a8ff-968dea20e6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:03.054259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629c0a2-f305-4417-a8ff-968dea20e6aa None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:03.054543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629c0a2-f305-4417-a8ff-968dea20e6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:03.054817 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629c0a2-f305-4417-a8ff-968dea20e6aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:03.055639 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629c0a2-f305-4417-a8ff-968dea20e6aa None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=1ff81129f179478d901b590a5be64f38) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:03.055948 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629c0a2-f305-4417-a8ff-968dea20e6aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:03.057409 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629c0a2-f305-4417-a8ff-968dea20e6aa None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:03.062800 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 261/530] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:02 2022] GET /identity/v3/role_assignments?user.id=1ff81129f179478d901b590a5be64f38&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:03.063573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629c0a2-f305-4417-a8ff-968dea20e6aa None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:03.174823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 270/531] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:03.174823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31510f3-81b7-492d-bbe9-2eb0afced814 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:03.205068 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:03.217114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629c0a2-f305-4417-a8ff-968dea20e6aa None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:03.218645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:03.255853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831c925-54e6-4357-88d0-36ba9a970beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:03.256763 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831c925-54e6-4357-88d0-36ba9a970beb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:03.257211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831c925-54e6-4357-88d0-36ba9a970beb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:03.257626 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831c925-54e6-4357-88d0-36ba9a970beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:03.258617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831c925-54e6-4357-88d0-36ba9a970beb None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=a7d1be247c09473ab5f4ac224347a359) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:03.259069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831c925-54e6-4357-88d0-36ba9a970beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:03.260643 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831c925-54e6-4357-88d0-36ba9a970beb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:03.266671 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 262/532] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:03 2022] GET /identity/v3/role_assignments?user.id=a7d1be247c09473ab5f4ac224347a359&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:03.267726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831c925-54e6-4357-88d0-36ba9a970beb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:03.319238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31510f3-81b7-492d-bbe9-2eb0afced814 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:03.362075 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaed6f5-32cb-4ae4-a204-485d50ce28a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:03.362965 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed6f5-32cb-4ae4-a204-485d50ce28a5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:03.363404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed6f5-32cb-4ae4-a204-485d50ce28a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:03.363784 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed6f5-32cb-4ae4-a204-485d50ce28a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:03.364646 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaed6f5-32cb-4ae4-a204-485d50ce28a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:03.365097 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaed6f5-32cb-4ae4-a204-485d50ce28a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:03.366616 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaed6f5-32cb-4ae4-a204-485d50ce28a5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:03.381707 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 271/533] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:03.387351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaed6f5-32cb-4ae4-a204-485d50ce28a5 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:03.488854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831c925-54e6-4357-88d0-36ba9a970beb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:03.558845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:03.570088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc7859-4611-4efd-86b3-18a7a3725fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:03.571682 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc7859-4611-4efd-86b3-18a7a3725fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:03.571971 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc7859-4611-4efd-86b3-18a7a3725fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:03.572247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc7859-4611-4efd-86b3-18a7a3725fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:03.579041 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaed6f5-32cb-4ae4-a204-485d50ce28a5 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:03.593650 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc7859-4611-4efd-86b3-18a7a3725fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:03.595100 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc7859-4611-4efd-86b3-18a7a3725fd6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-47bc7859-4611-4efd-86b3-18a7a3725fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:03.624076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:03.625004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:03.625846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:03.625846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:03.625846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:03.625846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:03.634783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 263/534] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:03.637456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c9245-17bd-4af4-b93a-c2ea6ea7a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:03.638510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9245-17bd-4af4-b93a-c2ea6ea7a995 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:03.638987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9245-17bd-4af4-b93a-c2ea6ea7a995 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:03.639469 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9245-17bd-4af4-b93a-c2ea6ea7a995 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:03.640515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc7859-4611-4efd-86b3-18a7a3725fd6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:03.661633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c9245-17bd-4af4-b93a-c2ea6ea7a995 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:03.663554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c9245-17bd-4af4-b93a-c2ea6ea7a995 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:03.669544 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0e2c9245-17bd-4af4-b93a-c2ea6ea7a995 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:03.690477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:03.692036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:03.692860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:03.692860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:03.692860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:03.692860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:03.692860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:03.692860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:03.692860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:03.692860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:03.692860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 272/535] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:03.697800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c9245-17bd-4af4-b93a-c2ea6ea7a995 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:03.776393 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc7859-4611-4efd-86b3-18a7a3725fd6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:03.813014 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff06f6d-b37e-43ca-802c-aef125b3515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:03.814136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff06f6d-b37e-43ca-802c-aef125b3515e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:03.814624 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff06f6d-b37e-43ca-802c-aef125b3515e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:03.815109 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff06f6d-b37e-43ca-802c-aef125b3515e None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:03.816029 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff06f6d-b37e-43ca-802c-aef125b3515e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:03.817105 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff06f6d-b37e-43ca-802c-aef125b3515e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:03.818687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff06f6d-b37e-43ca-802c-aef125b3515e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:03.831405 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 264/536] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:03.836957 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff06f6d-b37e-43ca-802c-aef125b3515e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:03.909321 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:03.946633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff06f6d-b37e-43ca-802c-aef125b3515e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:03.969741 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c9245-17bd-4af4-b93a-c2ea6ea7a995 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:04.011694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003d900-3fc7-48c4-88df-8b6c0419bd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:04.012515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003d900-3fc7-48c4-88df-8b6c0419bd9f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:04.012858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003d900-3fc7-48c4-88df-8b6c0419bd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:04.013175 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003d900-3fc7-48c4-88df-8b6c0419bd9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:04.023907 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fbb6c-2986-4a7b-8c46-b43a63399705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:04.024576 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fbb6c-2986-4a7b-8c46-b43a63399705 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:04.024860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fbb6c-2986-4a7b-8c46-b43a63399705 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:04.025827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003d900-3fc7-48c4-88df-8b6c0419bd9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:04.027310 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003d900-3fc7-48c4-88df-8b6c0419bd9f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:04.027766 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fbb6c-2986-4a7b-8c46-b43a63399705 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:04.028560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fbb6c-2986-4a7b-8c46-b43a63399705 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:04.028881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fbb6c-2986-4a7b-8c46-b43a63399705 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:04.030315 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fbb6c-2986-4a7b-8c46-b43a63399705 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:04.056420 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 273/537] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-2003d900-3fc7-48c4-88df-8b6c0419bd9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:04.058485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:04.059280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:04.060180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:04.060180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:04.060180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:04.060180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:04.060180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:04.060180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:04.060180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:04.060180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:04.060180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 265/538] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:04.062523 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fbb6c-2986-4a7b-8c46-b43a63399705 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:04.069714 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003d900-3fc7-48c4-88df-8b6c0419bd9f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:04.096964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:04.214611 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003d900-3fc7-48c4-88df-8b6c0419bd9f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:04.247815 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fbb6c-2986-4a7b-8c46-b43a63399705 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:04.248151 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:04.267707 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aae98-bf28-4f13-9d65-7a62f8f02999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:04.268685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aae98-bf28-4f13-9d65-7a62f8f02999 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:04.269920 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aae98-bf28-4f13-9d65-7a62f8f02999 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:04.271439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aae98-bf28-4f13-9d65-7a62f8f02999 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:04.272539 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aae98-bf28-4f13-9d65-7a62f8f02999 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:04.273210 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aae98-bf28-4f13-9d65-7a62f8f02999 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:04.275498 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aae98-bf28-4f13-9d65-7a62f8f02999 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:04.304325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 266/539] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:04.310832 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aae98-bf28-4f13-9d65-7a62f8f02999 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:04.323687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d3746-e13f-4fe1-80a0-80f4126a2ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:04.324409 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d3746-e13f-4fe1-80a0-80f4126a2ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:04.324700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d3746-e13f-4fe1-80a0-80f4126a2ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:04.325000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d3746-e13f-4fe1-80a0-80f4126a2ef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:04.325833 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d3746-e13f-4fe1-80a0-80f4126a2ef7 None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=0712574ba8f54b4283c50a74019d315b) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:04.326146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d3746-e13f-4fe1-80a0-80f4126a2ef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:04.327591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d3746-e13f-4fe1-80a0-80f4126a2ef7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:04.334549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 274/540] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:04 2022] GET /identity/v3/role_assignments?user.id=0712574ba8f54b4283c50a74019d315b&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:04.485863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aae98-bf28-4f13-9d65-7a62f8f02999 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:04.529742 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a726bba-22cf-401c-86c5-c47008893e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:04.530405 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a726bba-22cf-401c-86c5-c47008893e79 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:04.530689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a726bba-22cf-401c-86c5-c47008893e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:04.530962 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a726bba-22cf-401c-86c5-c47008893e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:04.531795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a726bba-22cf-401c-86c5-c47008893e79 None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=878b64982654402297d65a8ca4ad6ef0) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:04.532108 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a726bba-22cf-401c-86c5-c47008893e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:04.533637 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a726bba-22cf-401c-86c5-c47008893e79 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:04.540312 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 267/541] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:04 2022] GET /identity/v3/role_assignments?user.id=878b64982654402297d65a8ca4ad6ef0&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:04.835671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4726c-476c-4ebf-aa3e-fc27f10a2a4f None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:04.836043 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4726c-476c-4ebf-aa3e-fc27f10a2a4f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:04.836241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4726c-476c-4ebf-aa3e-fc27f10a2a4f None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:04.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 275/542] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:04.843161 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff594f38-d77f-4a9f-b14b-7ef42013ea86 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:04.843584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff594f38-d77f-4a9f-b14b-7ef42013ea86 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:04.843767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff594f38-d77f-4a9f-b14b-7ef42013ea86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:04.866505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ff594f38-d77f-4a9f-b14b-7ef42013ea86 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:04.867694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ff594f38-d77f-4a9f-b14b-7ef42013ea86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:04.939271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:04.962088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 268/543] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:04.993496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4726c-476c-4ebf-aa3e-fc27f10a2a4f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:05.077303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:05.104127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4726c-476c-4ebf-aa3e-fc27f10a2a4f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:05.140044 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed6ba9-85df-4d56-874e-bfeb1a072703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:05.140856 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed6ba9-85df-4d56-874e-bfeb1a072703 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:05.141238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed6ba9-85df-4d56-874e-bfeb1a072703 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:05.141519 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed6ba9-85df-4d56-874e-bfeb1a072703 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:05.151986 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed6ba9-85df-4d56-874e-bfeb1a072703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-01ed6ba9-85df-4d56-874e-bfeb1a072703 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:05.159796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:05.160695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:05.161542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 276/544] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:05.167771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff594f38-d77f-4a9f-b14b-7ef42013ea86 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:05.318837 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff594f38-d77f-4a9f-b14b-7ef42013ea86 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:05.353006 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274ea8-979f-49ec-b836-4071a57ec8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:05.353682 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274ea8-979f-49ec-b836-4071a57ec8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:05.353965 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274ea8-979f-49ec-b836-4071a57ec8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:05.354292 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274ea8-979f-49ec-b836-4071a57ec8f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:05.354974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274ea8-979f-49ec-b836-4071a57ec8f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:05.355277 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274ea8-979f-49ec-b836-4071a57ec8f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:05.356639 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274ea8-979f-49ec-b836-4071a57ec8f6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:05.365840 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 269/545] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:05.371193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed6ba9-85df-4d56-874e-bfeb1a072703 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:05.497131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf84f3-f132-44eb-a0b5-35ceb9725388 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:05.497564 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf84f3-f132-44eb-a0b5-35ceb9725388 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:05.497977 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf84f3-f132-44eb-a0b5-35ceb9725388 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:05.501837 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 270/546] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:05.507607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbd135-8808-4574-82c9-86dced13e78b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:05.508029 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbd135-8808-4574-82c9-86dced13e78b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:05.508437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbd135-8808-4574-82c9-86dced13e78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:05.532096 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d3dbd135-8808-4574-82c9-86dced13e78b None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:05.533368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d3dbd135-8808-4574-82c9-86dced13e78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:05.559289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed6ba9-85df-4d56-874e-bfeb1a072703 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:05.611483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:05.622290 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1d731-3328-4d76-aecd-6a50e93566d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:05.623094 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1d731-3328-4d76-aecd-6a50e93566d6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:05.623375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1d731-3328-4d76-aecd-6a50e93566d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:05.623651 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1d731-3328-4d76-aecd-6a50e93566d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:05.627299 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:05.641092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1d731-3328-4d76-aecd-6a50e93566d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:05.644541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1d731-3328-4d76-aecd-6a50e93566d6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:05.658708 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 271/547] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:05.660611 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8603-0ed6-456a-97fd-52a9cf32bb38 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:05.660929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8603-0ed6-456a-97fd-52a9cf32bb38 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:05.661223 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8603-0ed6-456a-97fd-52a9cf32bb38 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:05.662735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 272/548] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:05.667750 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62954-8fe8-4545-9e2e-d260ae237d85 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:05.668039 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62954-8fe8-4545-9e2e-d260ae237d85 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:05.668324 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62954-8fe8-4545-9e2e-d260ae237d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c8b1d731-3328-4d76-aecd-6a50e93566d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:05.674064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:05.674896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:05.675790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:05.675790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:05.675790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:05.675790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:05.675790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 277/549] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:05.683871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1d731-3328-4d76-aecd-6a50e93566d6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:05.694833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f0b62954-8fe8-4545-9e2e-d260ae237d85 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:05.696286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f0b62954-8fe8-4545-9e2e-d260ae237d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:05.781046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 273/550] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:02:05.782720 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b62954-8fe8-4545-9e2e-d260ae237d85 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:05.813449 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1d731-3328-4d76-aecd-6a50e93566d6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:05.851866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75203387-89e7-4d6c-84f7-855fe4366d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:05.852568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203387-89e7-4d6c-84f7-855fe4366d74 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:05.852852 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203387-89e7-4d6c-84f7-855fe4366d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:05.853175 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203387-89e7-4d6c-84f7-855fe4366d74 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:05.853895 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75203387-89e7-4d6c-84f7-855fe4366d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:05.854206 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75203387-89e7-4d6c-84f7-855fe4366d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:05.855580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75203387-89e7-4d6c-84f7-855fe4366d74 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:05.868689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 278/551] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:05.873221 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75203387-89e7-4d6c-84f7-855fe4366d74 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:05.923909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b62954-8fe8-4545-9e2e-d260ae237d85 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:05.928064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:05.939526 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:05.968454 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fec56-74bd-44b4-9881-0f8674bb8a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:05.969909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fec56-74bd-44b4-9881-0f8674bb8a09 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:05.969909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fec56-74bd-44b4-9881-0f8674bb8a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:05.970106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fec56-74bd-44b4-9881-0f8674bb8a09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:05.981091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fec56-74bd-44b4-9881-0f8674bb8a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-625fec56-74bd-44b4-9881-0f8674bb8a09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:05.989908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:05.991368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 274/552] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:05.992286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fec56-74bd-44b4-9881-0f8674bb8a09 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:06.013227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75203387-89e7-4d6c-84f7-855fe4366d74 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:06.066067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442dc5f-ef01-4ab3-a553-d24fddea2652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:06.068414 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442dc5f-ef01-4ab3-a553-d24fddea2652 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:06.068877 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442dc5f-ef01-4ab3-a553-d24fddea2652 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:06.069597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442dc5f-ef01-4ab3-a553-d24fddea2652 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:06.083562 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442dc5f-ef01-4ab3-a553-d24fddea2652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-f442dc5f-ef01-4ab3-a553-d24fddea2652 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:06.094468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:06.095612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:06.096724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:06.100563 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 279/553] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:06.101971 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442dc5f-ef01-4ab3-a553-d24fddea2652 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:06.117280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fec56-74bd-44b4-9881-0f8674bb8a09 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:06.154464 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a7fd-1ebc-4136-b1b1-dd9cabc1490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:06.155331 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a7fd-1ebc-4136-b1b1-dd9cabc1490a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:06.155683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a7fd-1ebc-4136-b1b1-dd9cabc1490a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:06.156034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a7fd-1ebc-4136-b1b1-dd9cabc1490a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:06.164483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2a7fd-1ebc-4136-b1b1-dd9cabc1490a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:06.166077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2a7fd-1ebc-4136-b1b1-dd9cabc1490a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-eef2a7fd-1ebc-4136-b1b1-dd9cabc1490a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:06.181580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:06.182537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:06.183444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:06.183444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:06.183444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:06.183444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:06.183444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:06.183444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:06.183444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:06.183444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:06.183444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:06.183444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:06.187654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 275/554] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:06.188630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a7fd-1ebc-4136-b1b1-dd9cabc1490a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:06.215301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:06.243006 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442dc5f-ef01-4ab3-a553-d24fddea2652 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:06.252979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:06.280040 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae14a5-fc62-46cb-9377-f843b88e1c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:06.280805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae14a5-fc62-46cb-9377-f843b88e1c33 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:06.281191 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae14a5-fc62-46cb-9377-f843b88e1c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:06.281542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae14a5-fc62-46cb-9377-f843b88e1c33 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:06.282354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae14a5-fc62-46cb-9377-f843b88e1c33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:06.282726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae14a5-fc62-46cb-9377-f843b88e1c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:06.284180 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae14a5-fc62-46cb-9377-f843b88e1c33 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:06.298520 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 280/555] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:06.299325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae14a5-fc62-46cb-9377-f843b88e1c33 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:06.315696 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a7fd-1ebc-4136-b1b1-dd9cabc1490a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:06.367170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ced0e-31d7-4b76-bc89-05fe96355dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:06.368740 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ced0e-31d7-4b76-bc89-05fe96355dde None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:06.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ced0e-31d7-4b76-bc89-05fe96355dde None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:06.369732 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ced0e-31d7-4b76-bc89-05fe96355dde None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:06.371243 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ced0e-31d7-4b76-bc89-05fe96355dde None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:06.371994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ced0e-31d7-4b76-bc89-05fe96355dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:06.373590 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ced0e-31d7-4b76-bc89-05fe96355dde None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:06.385240 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 276/556] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:06.386274 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ced0e-31d7-4b76-bc89-05fe96355dde None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:06.421311 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae14a5-fc62-46cb-9377-f843b88e1c33 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:06.460550 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7c37e-ab26-4d64-953b-5b785eed0145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:06.461153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7c37e-ab26-4d64-953b-5b785eed0145 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:06.461507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7c37e-ab26-4d64-953b-5b785eed0145 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:06.461869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7c37e-ab26-4d64-953b-5b785eed0145 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:06.462817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7c37e-ab26-4d64-953b-5b785eed0145 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:06.463213 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7c37e-ab26-4d64-953b-5b785eed0145 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:06.464804 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7c37e-ab26-4d64-953b-5b785eed0145 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:06.489467 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 281/557] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 10:02:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:06.490264 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7c37e-ab26-4d64-953b-5b785eed0145 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:06.498107 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:06.519294 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ced0e-31d7-4b76-bc89-05fe96355dde None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:06.523313 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:06.562660 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8acca6-ab19-45a6-9a71-123890f08029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:06.563651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8acca6-ab19-45a6-9a71-123890f08029 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:06.563974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8acca6-ab19-45a6-9a71-123890f08029 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:06.564327 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8acca6-ab19-45a6-9a71-123890f08029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:06.575556 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8acca6-ab19-45a6-9a71-123890f08029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:06.577236 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8acca6-ab19-45a6-9a71-123890f08029 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-5d8acca6-ab19-45a6-9a71-123890f08029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:06.595812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:06.597218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:06.598760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:06.598760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:06.598760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:06.598760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:06.602275 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 277/558] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:06.603267 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8acca6-ab19-45a6-9a71-123890f08029 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:06.622669 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7c37e-ab26-4d64-953b-5b785eed0145 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:06.664994 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ea25e-d191-4181-b48c-b4ca5e75b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:06.666513 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ea25e-d191-4181-b48c-b4ca5e75b516 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:06.667210 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ea25e-d191-4181-b48c-b4ca5e75b516 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:06.667671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ea25e-d191-4181-b48c-b4ca5e75b516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:06.684492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ea25e-d191-4181-b48c-b4ca5e75b516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:06.686188 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ea25e-d191-4181-b48c-b4ca5e75b516 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-038ea25e-d191-4181-b48c-b4ca5e75b516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:06.710649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:06.711757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:06.712933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:06.712933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:06.712933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:06.712933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:06.718683 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 282/559] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:06.719610 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ea25e-d191-4181-b48c-b4ca5e75b516 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:06.722291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8acca6-ab19-45a6-9a71-123890f08029 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:06.760762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99916d64-b579-48c4-8dee-bc4aabb2478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:06.761448 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99916d64-b579-48c4-8dee-bc4aabb2478f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:06.761733 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99916d64-b579-48c4-8dee-bc4aabb2478f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:06.762016 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99916d64-b579-48c4-8dee-bc4aabb2478f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:06.771304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:06.809551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:06.831808 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ea25e-d191-4181-b48c-b4ca5e75b516 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:06.833606 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99916d64-b579-48c4-8dee-bc4aabb2478f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:06.835997 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99916d64-b579-48c4-8dee-bc4aabb2478f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:06.866650 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd23453-4a05-46d4-803f-aa8e88cbe96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:06.867319 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd23453-4a05-46d4-803f-aa8e88cbe96f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:06.867607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd23453-4a05-46d4-803f-aa8e88cbe96f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:06.867898 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd23453-4a05-46d4-803f-aa8e88cbe96f None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:06.868611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd23453-4a05-46d4-803f-aa8e88cbe96f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:06.868941 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd23453-4a05-46d4-803f-aa8e88cbe96f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:06.870310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd23453-4a05-46d4-803f-aa8e88cbe96f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:06.882248 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 283/560] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:06.883052 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd23453-4a05-46d4-803f-aa8e88cbe96f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:06.951860 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 278/561] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:06.953835 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311b370-0f90-4305-ae7b-4d2755435236 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:06.954121 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311b370-0f90-4305-ae7b-4d2755435236 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:06.954403 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311b370-0f90-4305-ae7b-4d2755435236 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:06.955818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 279/562] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:06.956356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311b370-0f90-4305-ae7b-4d2755435236 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:06.995977 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd23453-4a05-46d4-803f-aa8e88cbe96f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:07.000644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:07.029411 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930660f-16b0-4481-b573-0683edd9b63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:07.030085 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930660f-16b0-4481-b573-0683edd9b63a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.030378 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930660f-16b0-4481-b573-0683edd9b63a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.030656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930660f-16b0-4481-b573-0683edd9b63a None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.031368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930660f-16b0-4481-b573-0683edd9b63a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:07.031677 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930660f-16b0-4481-b573-0683edd9b63a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:07.033085 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930660f-16b0-4481-b573-0683edd9b63a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:07.042377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:07.052661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 284/563] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:07.052661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a551-9b23-475b-9215-dac63705886d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.052661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a551-9b23-475b-9215-dac63705886d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.052661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a551-9b23-475b-9215-dac63705886d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.062735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311b370-0f90-4305-ae7b-4d2755435236 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:07.067660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b692a551-9b23-475b-9215-dac63705886d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:07.068851 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b692a551-9b23-475b-9215-dac63705886d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:07.095427 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc95ba5-ead8-4271-b30c-44bede2f0106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:07.096205 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc95ba5-ead8-4271-b30c-44bede2f0106 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.096483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc95ba5-ead8-4271-b30c-44bede2f0106 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.096764 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc95ba5-ead8-4271-b30c-44bede2f0106 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.104082 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc95ba5-ead8-4271-b30c-44bede2f0106 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:07.105537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc95ba5-ead8-4271-b30c-44bede2f0106 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-dbc95ba5-ead8-4271-b30c-44bede2f0106 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:07.120384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:07.121489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 280/564] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 10:02:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:07.122433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc95ba5-ead8-4271-b30c-44bede2f0106 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:07.138139 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 285/565] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:07.139496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f124ef7-7629-4bd0-be80-36b9a562de92 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.139791 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f124ef7-7629-4bd0-be80-36b9a562de92 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.140073 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f124ef7-7629-4bd0-be80-36b9a562de92 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.141496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 286/566] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:07.142102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f124ef7-7629-4bd0-be80-36b9a562de92 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:07.217020 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:07.220873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc95ba5-ead8-4271-b30c-44bede2f0106 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:07.246407 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f124ef7-7629-4bd0-be80-36b9a562de92 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:07.253866 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f6e36-848f-4969-9dce-0ea87eabfd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:07.254715 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f6e36-848f-4969-9dce-0ea87eabfd87 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.255000 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f6e36-848f-4969-9dce-0ea87eabfd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.255272 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f6e36-848f-4969-9dce-0ea87eabfd87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.264870 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f6e36-848f-4969-9dce-0ea87eabfd87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:07.266345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f6e36-848f-4969-9dce-0ea87eabfd87 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:07.274893 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:07.280519 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602da54-2ede-4ebc-b2ef-196450f0d23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:07.281341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602da54-2ede-4ebc-b2ef-196450f0d23b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.281632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602da54-2ede-4ebc-b2ef-196450f0d23b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.281913 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602da54-2ede-4ebc-b2ef-196450f0d23b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-153f6e36-848f-4969-9dce-0ea87eabfd87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:07.286793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:07.287672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:07.288546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:07.288546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:07.288546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:07.288546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:07.288546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 281/567] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:07.288546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f6e36-848f-4969-9dce-0ea87eabfd87 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:07.289756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602da54-2ede-4ebc-b2ef-196450f0d23b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:07.291232 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602da54-2ede-4ebc-b2ef-196450f0d23b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-8602da54-2ede-4ebc-b2ef-196450f0d23b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:07.306601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:07.307606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 287/568] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f9ba3-542d-4eba-9386-e466e452501a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.313256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f9ba3-542d-4eba-9386-e466e452501a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.314108 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f9ba3-542d-4eba-9386-e466e452501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.327938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-239f9ba3-542d-4eba-9386-e466e452501a None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:07.329141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-239f9ba3-542d-4eba-9386-e466e452501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:07.389473 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f6e36-848f-4969-9dce-0ea87eabfd87 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:07.394036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 288/569] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:07.395353 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f9ba3-542d-4eba-9386-e466e452501a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:07.425963 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9e450-34a2-47be-8536-1e0fb98504a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:07.426634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9e450-34a2-47be-8536-1e0fb98504a7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.426925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9e450-34a2-47be-8536-1e0fb98504a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.427202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9e450-34a2-47be-8536-1e0fb98504a7 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.428036 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9e450-34a2-47be-8536-1e0fb98504a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:07.428348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9e450-34a2-47be-8536-1e0fb98504a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:07.429814 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9e450-34a2-47be-8536-1e0fb98504a7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:07.446313 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 282/570] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 10:02:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:07.447211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9e450-34a2-47be-8536-1e0fb98504a7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:07.462230 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:07.496064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f9ba3-542d-4eba-9386-e466e452501a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:07.515119 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:07.530633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6e2f1-b2f7-4f9a-95b3-3d3e036b7bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:07.531436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6e2f1-b2f7-4f9a-95b3-3d3e036b7bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.531727 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6e2f1-b2f7-4f9a-95b3-3d3e036b7bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.532000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6e2f1-b2f7-4f9a-95b3-3d3e036b7bc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.542922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6e2f1-b2f7-4f9a-95b3-3d3e036b7bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-5ee6e2f1-b2f7-4f9a-95b3-3d3e036b7bc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:07.551200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:07.552326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:07.553200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:07.553833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9e450-34a2-47be-8536-1e0fb98504a7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:07.553908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 289/571] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:07.553908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6e2f1-b2f7-4f9a-95b3-3d3e036b7bc8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:07.589170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dc5dd-cccd-4e6a-b0aa-293956d64026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:07.589830 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc5dd-cccd-4e6a-b0aa-293956d64026 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.590118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc5dd-cccd-4e6a-b0aa-293956d64026 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.590398 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dc5dd-cccd-4e6a-b0aa-293956d64026 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.591117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dc5dd-cccd-4e6a-b0aa-293956d64026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:07.591429 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dc5dd-cccd-4e6a-b0aa-293956d64026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:07.592811 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dc5dd-cccd-4e6a-b0aa-293956d64026 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:07.603691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 283/572] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:07.604473 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dc5dd-cccd-4e6a-b0aa-293956d64026 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:07.650844 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6e2f1-b2f7-4f9a-95b3-3d3e036b7bc8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:07.671998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:07.683423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbea71-16f1-433d-8922-52b1235b07ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:07.684093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbea71-16f1-433d-8922-52b1235b07ea None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.684380 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbea71-16f1-433d-8922-52b1235b07ea None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.684662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbea71-16f1-433d-8922-52b1235b07ea None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.685538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbea71-16f1-433d-8922-52b1235b07ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:07.685854 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbea71-16f1-433d-8922-52b1235b07ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:07.687294 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbea71-16f1-433d-8922-52b1235b07ea None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:07.704388 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 290/573] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 10:02:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:07.704513 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dc5dd-cccd-4e6a-b0aa-293956d64026 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:07.705222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbea71-16f1-433d-8922-52b1235b07ea None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:07.740757 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563fe3f-37aa-4a72-a517-9fe79df90fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:07.741579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563fe3f-37aa-4a72-a517-9fe79df90fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.741871 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563fe3f-37aa-4a72-a517-9fe79df90fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.742151 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563fe3f-37aa-4a72-a517-9fe79df90fe4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.742904 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:07.752472 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563fe3f-37aa-4a72-a517-9fe79df90fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-a563fe3f-37aa-4a72-a517-9fe79df90fe4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:07.760646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:07.761739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:07.762574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 284/574] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:07.763255 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563fe3f-37aa-4a72-a517-9fe79df90fe4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:07.806404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbea71-16f1-433d-8922-52b1235b07ea None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:07.840526 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4656a-ce76-4d5b-ae05-8a8969bc91d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:07.841350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4656a-ce76-4d5b-ae05-8a8969bc91d1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.841639 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4656a-ce76-4d5b-ae05-8a8969bc91d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.841920 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4656a-ce76-4d5b-ae05-8a8969bc91d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.851713 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4656a-ce76-4d5b-ae05-8a8969bc91d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:07.853198 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4656a-ce76-4d5b-ae05-8a8969bc91d1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:07.858640 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563fe3f-37aa-4a72-a517-9fe79df90fe4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-62a4656a-ce76-4d5b-ae05-8a8969bc91d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:07.870820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:07.871682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:07.872547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:07.872547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:07.872547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:07.872547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:07.872547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 291/575] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:07.873248 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4656a-ce76-4d5b-ae05-8a8969bc91d1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:07.888034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:07.896612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4164bf-2524-42d9-8a81-d772563af465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:07.897302 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4164bf-2524-42d9-8a81-d772563af465 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:07.897584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4164bf-2524-42d9-8a81-d772563af465 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:07.897859 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4164bf-2524-42d9-8a81-d772563af465 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:07.898591 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4164bf-2524-42d9-8a81-d772563af465 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:07.898902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4164bf-2524-42d9-8a81-d772563af465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:07.900251 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4164bf-2524-42d9-8a81-d772563af465 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:07.907822 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 285/576] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:07.908588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4164bf-2524-42d9-8a81-d772563af465 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:07.962120 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:07.971622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4656a-ce76-4d5b-ae05-8a8969bc91d1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.005055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9967b-d5c3-4cf4-870a-9693c17a5a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.005773 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9967b-d5c3-4cf4-870a-9693c17a5a3f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.006016 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4164bf-2524-42d9-8a81-d772563af465 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.006476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9967b-d5c3-4cf4-870a-9693c17a5a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.006476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9967b-d5c3-4cf4-870a-9693c17a5a3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.013303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9967b-d5c3-4cf4-870a-9693c17a5a3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.014836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9967b-d5c3-4cf4-870a-9693c17a5a3f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-88f9967b-d5c3-4cf4-870a-9693c17a5a3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:08.028293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:08.029242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:08.030662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:08.030662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:08.030662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:08.030662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:08.030662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:08.030662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:08.030662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:08.030662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:08.030662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 292/577] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:08.030662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9967b-d5c3-4cf4-870a-9693c17a5a3f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.042286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24216877-b303-4b6f-9d6b-2dc5726ae52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.043078 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24216877-b303-4b6f-9d6b-2dc5726ae52f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.043628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24216877-b303-4b6f-9d6b-2dc5726ae52f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.043912 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24216877-b303-4b6f-9d6b-2dc5726ae52f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.054904 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24216877-b303-4b6f-9d6b-2dc5726ae52f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.056327 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24216877-b303-4b6f-9d6b-2dc5726ae52f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-24216877-b303-4b6f-9d6b-2dc5726ae52f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:08.073486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:08.074433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:08.075298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:08.075298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:08.075298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:08.075298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:08.075828 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 286/578] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:08.076765 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24216877-b303-4b6f-9d6b-2dc5726ae52f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.117289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:08.130511 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9967b-d5c3-4cf4-870a-9693c17a5a3f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.162652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e374a1-759b-4c5f-80bf-c12bf1af6537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.163307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e374a1-759b-4c5f-80bf-c12bf1af6537 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.163595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e374a1-759b-4c5f-80bf-c12bf1af6537 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.163864 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e374a1-759b-4c5f-80bf-c12bf1af6537 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.164590 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e374a1-759b-4c5f-80bf-c12bf1af6537 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:08.164924 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e374a1-759b-4c5f-80bf-c12bf1af6537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.166275 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e374a1-759b-4c5f-80bf-c12bf1af6537 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.172735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24216877-b303-4b6f-9d6b-2dc5726ae52f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.174016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 293/579] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:08.174787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e374a1-759b-4c5f-80bf-c12bf1af6537 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.193175 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:08.206482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65fe1d-4489-4bc7-a3ed-ff52a051c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.207161 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65fe1d-4489-4bc7-a3ed-ff52a051c168 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.207440 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65fe1d-4489-4bc7-a3ed-ff52a051c168 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.207720 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65fe1d-4489-4bc7-a3ed-ff52a051c168 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.208427 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65fe1d-4489-4bc7-a3ed-ff52a051c168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:08.208732 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65fe1d-4489-4bc7-a3ed-ff52a051c168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.210116 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65fe1d-4489-4bc7-a3ed-ff52a051c168 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.221615 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 287/580] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:08.222212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65fe1d-4489-4bc7-a3ed-ff52a051c168 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.280376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e374a1-759b-4c5f-80bf-c12bf1af6537 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.314674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf43ae6-260e-48d2-a5e5-340565bb26eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.315472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf43ae6-260e-48d2-a5e5-340565bb26eb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.315755 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf43ae6-260e-48d2-a5e5-340565bb26eb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.316036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf43ae6-260e-48d2-a5e5-340565bb26eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.319240 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65fe1d-4489-4bc7-a3ed-ff52a051c168 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.320749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:08.327481 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf43ae6-260e-48d2-a5e5-340565bb26eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.328949 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf43ae6-260e-48d2-a5e5-340565bb26eb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-adf43ae6-260e-48d2-a5e5-340565bb26eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:08.346135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:08.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:08.348534 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:08.348534 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:08.348534 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:08.348534 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:08.348534 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 294/581] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:08.349309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf43ae6-260e-48d2-a5e5-340565bb26eb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.356098 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adbd48-134d-4d4e-9156-e659c63adee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.356786 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adbd48-134d-4d4e-9156-e659c63adee0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.357100 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adbd48-134d-4d4e-9156-e659c63adee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.357374 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adbd48-134d-4d4e-9156-e659c63adee0 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.358159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26adbd48-134d-4d4e-9156-e659c63adee0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:08.358464 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26adbd48-134d-4d4e-9156-e659c63adee0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.359925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26adbd48-134d-4d4e-9156-e659c63adee0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.372077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 288/582] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:08.372849 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adbd48-134d-4d4e-9156-e659c63adee0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.409175 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:08.446338 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf43ae6-260e-48d2-a5e5-340565bb26eb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.468497 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adbd48-134d-4d4e-9156-e659c63adee0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.478648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e65d2-9658-4b8f-8e5e-7e09fdeac5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.479303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e65d2-9658-4b8f-8e5e-7e09fdeac5df None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.479586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e65d2-9658-4b8f-8e5e-7e09fdeac5df None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.479861 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e65d2-9658-4b8f-8e5e-7e09fdeac5df None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.480564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e65d2-9658-4b8f-8e5e-7e09fdeac5df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:08.480868 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e65d2-9658-4b8f-8e5e-7e09fdeac5df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.482249 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e65d2-9658-4b8f-8e5e-7e09fdeac5df None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.494250 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 295/583] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:08.495033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e65d2-9658-4b8f-8e5e-7e09fdeac5df None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.503557 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec11ec-d923-43f7-84a2-1be7729c9544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.504445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec11ec-d923-43f7-84a2-1be7729c9544 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.504735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec11ec-d923-43f7-84a2-1be7729c9544 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.505045 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec11ec-d923-43f7-84a2-1be7729c9544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.515405 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec11ec-d923-43f7-84a2-1be7729c9544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.516833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec11ec-d923-43f7-84a2-1be7729c9544 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-2aec11ec-d923-43f7-84a2-1be7729c9544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:08.533588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:08.534467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:08.535883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:08.535883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:08.535883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:08.535883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:08.535883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 289/584] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:08.536431 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec11ec-d923-43f7-84a2-1be7729c9544 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.555314 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:08.593705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e65d2-9658-4b8f-8e5e-7e09fdeac5df None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.617412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:08.628237 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac28c73-0e58-4906-b175-0a094d08e906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.629093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac28c73-0e58-4906-b175-0a094d08e906 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.629386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac28c73-0e58-4906-b175-0a094d08e906 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.629663 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac28c73-0e58-4906-b175-0a094d08e906 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.636532 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac28c73-0e58-4906-b175-0a094d08e906 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.636719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec11ec-d923-43f7-84a2-1be7729c9544 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.638021 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac28c73-0e58-4906-b175-0a094d08e906 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-1ac28c73-0e58-4906-b175-0a094d08e906 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:08.651547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:08.652580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:08.653566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:08.653566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:08.653566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:08.653566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:08.653566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:08.653566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:08.653566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:08.653566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:08.653566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 296/585] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:08.654034 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac28c73-0e58-4906-b175-0a094d08e906 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.676721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0887a2-34c3-4606-830f-aee9472e48d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.677416 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0887a2-34c3-4606-830f-aee9472e48d3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.677704 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0887a2-34c3-4606-830f-aee9472e48d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.677983 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0887a2-34c3-4606-830f-aee9472e48d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.678697 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0887a2-34c3-4606-830f-aee9472e48d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:08.679010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0887a2-34c3-4606-830f-aee9472e48d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.680376 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0887a2-34c3-4606-830f-aee9472e48d3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.691749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 290/586] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:08.692524 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0887a2-34c3-4606-830f-aee9472e48d3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.755141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac28c73-0e58-4906-b175-0a094d08e906 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.763983 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:08.787054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74128a3-d701-4e30-b24c-8ea5e3f28712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.787633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74128a3-d701-4e30-b24c-8ea5e3f28712 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.787918 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74128a3-d701-4e30-b24c-8ea5e3f28712 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.788198 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74128a3-d701-4e30-b24c-8ea5e3f28712 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.789051 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74128a3-d701-4e30-b24c-8ea5e3f28712 None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=1167f58a1ea3465083d67a94043066be) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:08.789366 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74128a3-d701-4e30-b24c-8ea5e3f28712 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.789456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0887a2-34c3-4606-830f-aee9472e48d3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.790797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74128a3-d701-4e30-b24c-8ea5e3f28712 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.796922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 297/587] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/role_assignments?user.id=1167f58a1ea3465083d67a94043066be&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:08.797703 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74128a3-d701-4e30-b24c-8ea5e3f28712 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.831289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630151e-b6d9-45bc-ac7a-8d4f4a3f3071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.832604 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630151e-b6d9-45bc-ac7a-8d4f4a3f3071 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.832885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630151e-b6d9-45bc-ac7a-8d4f4a3f3071 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.833201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630151e-b6d9-45bc-ac7a-8d4f4a3f3071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.840859 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630151e-b6d9-45bc-ac7a-8d4f4a3f3071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.842367 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630151e-b6d9-45bc-ac7a-8d4f4a3f3071 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.853954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f630151e-b6d9-45bc-ac7a-8d4f4a3f3071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:08.858375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:08.859303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:08.860183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:08.860183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:08.860183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:08.860183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:08.860183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:08.860183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:08.860183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:08.860183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:08.860183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 291/588] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:08.860672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630151e-b6d9-45bc-ac7a-8d4f4a3f3071 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:08.919001 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74128a3-d701-4e30-b24c-8ea5e3f28712 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.963420 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2c0e7-8881-44c8-9630-b8db5e141aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:08.964144 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c0e7-8881-44c8-9630-b8db5e141aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:08.964428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c0e7-8881-44c8-9630-b8db5e141aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:08.964712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c0e7-8881-44c8-9630-b8db5e141aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:08.965494 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2c0e7-8881-44c8-9630-b8db5e141aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:08.965850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2c0e7-8881-44c8-9630-b8db5e141aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:08.967206 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2c0e7-8881-44c8-9630-b8db5e141aa8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:08.970451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630151e-b6d9-45bc-ac7a-8d4f4a3f3071 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:08.979776 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 298/589] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:08.980562 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2c0e7-8881-44c8-9630-b8db5e141aa8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:09.013924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d21038-19b8-4b75-b9da-efdbabd22da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:09.014590 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d21038-19b8-4b75-b9da-efdbabd22da8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:09.014875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d21038-19b8-4b75-b9da-efdbabd22da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:09.015153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d21038-19b8-4b75-b9da-efdbabd22da8 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:09.015947 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d21038-19b8-4b75-b9da-efdbabd22da8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:09.016259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d21038-19b8-4b75-b9da-efdbabd22da8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:09.017758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d21038-19b8-4b75-b9da-efdbabd22da8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:09.020127 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:09.031462 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 292/590] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:09.032332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d21038-19b8-4b75-b9da-efdbabd22da8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:09.095222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2c0e7-8881-44c8-9630-b8db5e141aa8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:09.105712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:09.131615 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a6d8-f346-4d80-a36d-0355445ad88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:09.132517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a6d8-f346-4d80-a36d-0355445ad88e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:09.132884 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a6d8-f346-4d80-a36d-0355445ad88e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:09.133252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a6d8-f346-4d80-a36d-0355445ad88e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:09.141263 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a6d8-f346-4d80-a36d-0355445ad88e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:09.142793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a6d8-f346-4d80-a36d-0355445ad88e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:09.145084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d21038-19b8-4b75-b9da-efdbabd22da8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-30e9a6d8-f346-4d80-a36d-0355445ad88e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:09.161883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:09.162820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 299/591] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:09.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a6d8-f346-4d80-a36d-0355445ad88e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:09.185206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123f19f-e612-49da-835b-caba8c8d8e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:09.185868 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123f19f-e612-49da-835b-caba8c8d8e90 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:09.186151 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123f19f-e612-49da-835b-caba8c8d8e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:09.186426 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123f19f-e612-49da-835b-caba8c8d8e90 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:09.187221 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123f19f-e612-49da-835b-caba8c8d8e90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:09.187506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123f19f-e612-49da-835b-caba8c8d8e90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:09.188947 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123f19f-e612-49da-835b-caba8c8d8e90 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:09.206315 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 293/592] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:09.206315 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123f19f-e612-49da-835b-caba8c8d8e90 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:09.266488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:09.270250 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a6d8-f346-4d80-a36d-0355445ad88e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:09.313126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1284e5f-401e-48fe-a14a-6e9bd13938a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:09.314014 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1284e5f-401e-48fe-a14a-6e9bd13938a9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:09.314373 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1284e5f-401e-48fe-a14a-6e9bd13938a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:09.314719 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1284e5f-401e-48fe-a14a-6e9bd13938a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:09.321061 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123f19f-e612-49da-835b-caba8c8d8e90 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:09.322433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1284e5f-401e-48fe-a14a-6e9bd13938a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:09.323949 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1284e5f-401e-48fe-a14a-6e9bd13938a9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c1284e5f-401e-48fe-a14a-6e9bd13938a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:09.338544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:09.339662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:09.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:09.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:09.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:09.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:09.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:09.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:09.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:09.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:09.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 10:02:09.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:09.340754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 300/593] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:09.341376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1284e5f-401e-48fe-a14a-6e9bd13938a9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:09.364045 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3063e-c620-47ff-bb11-b0be318c3fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:09.365410 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3063e-c620-47ff-bb11-b0be318c3fec None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:09.365865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3063e-c620-47ff-bb11-b0be318c3fec None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:09.366365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3063e-c620-47ff-bb11-b0be318c3fec None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/1ff81129f179478d901b590a5be64f38/roles/0fa7c8540d8b472aace10fb2fc38b37b` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:09.368094 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:09.385567 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3063e-c620-47ff-bb11-b0be318c3fec None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=1ff81129f179478d901b590a5be64f38, role_id=0fa7c8540d8b472aace10fb2fc38b37b)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:09.387198 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3063e-c620-47ff-bb11-b0be318c3fec None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:09.401188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 294/594] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:02:09 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/1ff81129f179478d901b590a5be64f38/roles/0fa7c8540d8b472aace10fb2fc38b37b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:02:09.402265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3063e-c620-47ff-bb11-b0be318c3fec None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:09.462632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1284e5f-401e-48fe-a14a-6e9bd13938a9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:09.510817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a31a8-169c-40a3-b2cc-9b30bc521c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:09.511620 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a31a8-169c-40a3-b2cc-9b30bc521c64 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:09.511972 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a31a8-169c-40a3-b2cc-9b30bc521c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:09.512317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a31a8-169c-40a3-b2cc-9b30bc521c64 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:09.513321 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a31a8-169c-40a3-b2cc-9b30bc521c64 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:09.513780 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a31a8-169c-40a3-b2cc-9b30bc521c64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:09.515493 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a31a8-169c-40a3-b2cc-9b30bc521c64 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:09.537025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 301/595] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Jul 5 10:02:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:09.538127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a31a8-169c-40a3-b2cc-9b30bc521c64 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:09.562167 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3063e-c620-47ff-bb11-b0be318c3fec None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:09.566776 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:09.615079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6bc65-32e0-41e7-9ee1-686eee4db0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:09.616047 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6bc65-32e0-41e7-9ee1-686eee4db0aa None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:09.617554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6bc65-32e0-41e7-9ee1-686eee4db0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:09.617933 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6bc65-32e0-41e7-9ee1-686eee4db0aa None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/a7d1be247c09473ab5f4ac224347a359/roles/0fa7c8540d8b472aace10fb2fc38b37b` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:09.638929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6bc65-32e0-41e7-9ee1-686eee4db0aa None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=a7d1be247c09473ab5f4ac224347a359, role_id=0fa7c8540d8b472aace10fb2fc38b37b)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:09.640571 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6bc65-32e0-41e7-9ee1-686eee4db0aa None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:09.654344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:09.657557 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 295/596] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:02:09 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/a7d1be247c09473ab5f4ac224347a359/roles/0fa7c8540d8b472aace10fb2fc38b37b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:02:09.658955 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6bc65-32e0-41e7-9ee1-686eee4db0aa None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:09.672821 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a31a8-169c-40a3-b2cc-9b30bc521c64 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:09.714262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ca20a-9523-42b5-97eb-85779c116a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:09.715214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ca20a-9523-42b5-97eb-85779c116a6d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:09.715707 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ca20a-9523-42b5-97eb-85779c116a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:09.716131 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ca20a-9523-42b5-97eb-85779c116a6d None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:09.717236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ca20a-9523-42b5-97eb-85779c116a6d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:09.717676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ca20a-9523-42b5-97eb-85779c116a6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:09.719413 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ca20a-9523-42b5-97eb-85779c116a6d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:09.739999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 302/597] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 10:02:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:09.755193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ca20a-9523-42b5-97eb-85779c116a6d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:09.798626 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6bc65-32e0-41e7-9ee1-686eee4db0aa None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:09.839373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83bb64-ac15-47c3-bad4-e2b26de6d8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:09.840459 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83bb64-ac15-47c3-bad4-e2b26de6d8df None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:09.840859 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83bb64-ac15-47c3-bad4-e2b26de6d8df None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:09.841337 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83bb64-ac15-47c3-bad4-e2b26de6d8df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:09.855828 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83bb64-ac15-47c3-bad4-e2b26de6d8df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:09.856662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83bb64-ac15-47c3-bad4-e2b26de6d8df None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-3d83bb64-ac15-47c3-bad4-e2b26de6d8df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:09.877117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:09.878192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:09.879289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:09.879289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:09.879289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:09.879289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:09.880925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 296/598] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:09.886427 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83bb64-ac15-47c3-bad4-e2b26de6d8df None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:09.905385 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:09.924096 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ca20a-9523-42b5-97eb-85779c116a6d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:09.961668 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc8744-b6da-482d-86be-a991eb214cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:09.962718 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc8744-b6da-482d-86be-a991eb214cab None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:09.963145 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc8744-b6da-482d-86be-a991eb214cab None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:09.963572 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc8744-b6da-482d-86be-a991eb214cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:09.976288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc8744-b6da-482d-86be-a991eb214cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:09.978032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc8744-b6da-482d-86be-a991eb214cab None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:09.980972 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-afdc8744-b6da-482d-86be-a991eb214cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:10.001641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:10.002591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:10.003456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:10.003456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:10.003456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:10.003456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:10.003456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 303/599] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:10.010384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83bb64-ac15-47c3-bad4-e2b26de6d8df None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:10.011581 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc8744-b6da-482d-86be-a991eb214cab None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:10.080187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffb0e0-1238-48f5-b1c2-1f3e9967405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:10.081637 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffb0e0-1238-48f5-b1c2-1f3e9967405a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:10.082212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffb0e0-1238-48f5-b1c2-1f3e9967405a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:10.082923 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffb0e0-1238-48f5-b1c2-1f3e9967405a None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:10.084629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffb0e0-1238-48f5-b1c2-1f3e9967405a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:10.085306 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffb0e0-1238-48f5-b1c2-1f3e9967405a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:10.090264 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffb0e0-1238-48f5-b1c2-1f3e9967405a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:10.114250 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 297/600] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:10.120604 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffb0e0-1238-48f5-b1c2-1f3e9967405a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:10.177447 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc8744-b6da-482d-86be-a991eb214cab None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:10.209286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:10.212366 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e8730-c319-4496-9d1b-52cd3b04523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:10.213168 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e8730-c319-4496-9d1b-52cd3b04523a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:10.213353 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e8730-c319-4496-9d1b-52cd3b04523a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:10.213630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e8730-c319-4496-9d1b-52cd3b04523a None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:10.214388 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e8730-c319-4496-9d1b-52cd3b04523a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:10.214719 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e8730-c319-4496-9d1b-52cd3b04523a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:10.216065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e8730-c319-4496-9d1b-52cd3b04523a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:10.232976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 304/601] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:10.239683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffb0e0-1238-48f5-b1c2-1f3e9967405a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:10.241875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e8730-c319-4496-9d1b-52cd3b04523a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:10.276138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3085d-01a8-458a-ae26-39f45d69de44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:10.277518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3085d-01a8-458a-ae26-39f45d69de44 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:10.278081 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3085d-01a8-458a-ae26-39f45d69de44 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:10.278562 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3085d-01a8-458a-ae26-39f45d69de44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:10.295565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3085d-01a8-458a-ae26-39f45d69de44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:10.298094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3085d-01a8-458a-ae26-39f45d69de44 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-20b3085d-01a8-458a-ae26-39f45d69de44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:10.314641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:10.315553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:10.317070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:10.317070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:10.317070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:10.317070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:10.317070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:10.317070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:10.317070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:10.317070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:10.319661 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 298/602] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:10.325488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3085d-01a8-458a-ae26-39f45d69de44 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:10.360236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:10.420010 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e8730-c319-4496-9d1b-52cd3b04523a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:10.456089 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2c53b-29ca-4b39-bc27-87bbad8b20aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:10.456847 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2c53b-29ca-4b39-bc27-87bbad8b20aa None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:10.457160 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2c53b-29ca-4b39-bc27-87bbad8b20aa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:10.457439 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2c53b-29ca-4b39-bc27-87bbad8b20aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:10.464111 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3085d-01a8-458a-ae26-39f45d69de44 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:10.464236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2c53b-29ca-4b39-bc27-87bbad8b20aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:10.468936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2c53b-29ca-4b39-bc27-87bbad8b20aa None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-57d2c53b-29ca-4b39-bc27-87bbad8b20aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:10.485247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:10.486150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:10.487024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:10.487024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:10.487024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:10.487024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:10.487024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:10.487024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:10.487024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:10.487024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:10.487024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 305/603] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:10.490613 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2c53b-29ca-4b39-bc27-87bbad8b20aa None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:10.533242 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:10.547867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eed97-beb3-4b0a-8167-3331164d8c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:10.548773 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eed97-beb3-4b0a-8167-3331164d8c79 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:10.549179 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eed97-beb3-4b0a-8167-3331164d8c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:10.549584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eed97-beb3-4b0a-8167-3331164d8c79 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:10.550988 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047eed97-beb3-4b0a-8167-3331164d8c79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:10.551509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047eed97-beb3-4b0a-8167-3331164d8c79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:10.553282 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047eed97-beb3-4b0a-8167-3331164d8c79 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:10.583589 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 299/604] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:10.589433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eed97-beb3-4b0a-8167-3331164d8c79 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:10.622023 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2c53b-29ca-4b39-bc27-87bbad8b20aa None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:10.655423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:10.695154 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b444819-3486-4392-a5ff-55dbbbaabc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:10.695848 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b444819-3486-4392-a5ff-55dbbbaabc59 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:10.696132 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b444819-3486-4392-a5ff-55dbbbaabc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:10.696409 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b444819-3486-4392-a5ff-55dbbbaabc59 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:10.697240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b444819-3486-4392-a5ff-55dbbbaabc59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:10.697551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b444819-3486-4392-a5ff-55dbbbaabc59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:10.699047 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b444819-3486-4392-a5ff-55dbbbaabc59 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:10.732735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 306/605] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:10.742976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b444819-3486-4392-a5ff-55dbbbaabc59 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:10.776934 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eed97-beb3-4b0a-8167-3331164d8c79 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:10.814486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333f6ba-acc8-484f-b76e-c7c0c3f4db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:10.815379 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333f6ba-acc8-484f-b76e-c7c0c3f4db4c None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:10.815663 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333f6ba-acc8-484f-b76e-c7c0c3f4db4c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:10.815943 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333f6ba-acc8-484f-b76e-c7c0c3f4db4c None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/0712574ba8f54b4283c50a74019d315b/roles/0fa7c8540d8b472aace10fb2fc38b37b` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:10.833283 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333f6ba-acc8-484f-b76e-c7c0c3f4db4c None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=0712574ba8f54b4283c50a74019d315b, role_id=0fa7c8540d8b472aace10fb2fc38b37b)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:10.834736 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333f6ba-acc8-484f-b76e-c7c0c3f4db4c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:10.870496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 300/606] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:02:10 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/0712574ba8f54b4283c50a74019d315b/roles/0fa7c8540d8b472aace10fb2fc38b37b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 10:02:10.923338 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b444819-3486-4392-a5ff-55dbbbaabc59 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:10.983037 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e529f-2cce-4d61-b2f1-b9d90305d6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:10.984302 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e529f-2cce-4d61-b2f1-b9d90305d6b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:10.984810 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e529f-2cce-4d61-b2f1-b9d90305d6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:10.985310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e529f-2cce-4d61-b2f1-b9d90305d6b1 None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/878b64982654402297d65a8ca4ad6ef0/roles/0fa7c8540d8b472aace10fb2fc38b37b` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:11.008485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e529f-2cce-4d61-b2f1-b9d90305d6b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=878b64982654402297d65a8ca4ad6ef0, role_id=0fa7c8540d8b472aace10fb2fc38b37b)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:11.010347 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e529f-2cce-4d61-b2f1-b9d90305d6b1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:11.041740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 307/607] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:02:10 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/878b64982654402297d65a8ca4ad6ef0/roles/0fa7c8540d8b472aace10fb2fc38b37b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:02:11.082824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ceed2-6e92-472b-bdfc-c63717a88283 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:11.083834 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ceed2-6e92-472b-bdfc-c63717a88283 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:11.084330 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ceed2-6e92-472b-bdfc-c63717a88283 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:11.085993 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 301/608] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:11.091911 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee108f6a-2182-464f-90f9-28914f53113d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:11.092520 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee108f6a-2182-464f-90f9-28914f53113d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:11.093038 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee108f6a-2182-464f-90f9-28914f53113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:11.111975 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ee108f6a-2182-464f-90f9-28914f53113d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:11.113707 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ee108f6a-2182-464f-90f9-28914f53113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:11.137460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:11.192483 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 308/609] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:11.216667 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ceed2-6e92-472b-bdfc-c63717a88283 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:11.257666 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:11.331101 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ceed2-6e92-472b-bdfc-c63717a88283 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:11.366932 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada785-7303-4d03-8234-9fc706ef73df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:11.367731 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada785-7303-4d03-8234-9fc706ef73df None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:11.368010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada785-7303-4d03-8234-9fc706ef73df None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:11.368278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada785-7303-4d03-8234-9fc706ef73df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:11.379569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ada785-7303-4d03-8234-9fc706ef73df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e7ada785-7303-4d03-8234-9fc706ef73df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:11.387370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:11.388298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:11.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 302/610] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:11.399278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee108f6a-2182-464f-90f9-28914f53113d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:11.515687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee108f6a-2182-464f-90f9-28914f53113d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:11.573628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b0005-e383-43b3-97a5-26c68961450e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:11.574709 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0005-e383-43b3-97a5-26c68961450e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:11.575217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0005-e383-43b3-97a5-26c68961450e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:11.575698 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0005-e383-43b3-97a5-26c68961450e None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:11.576662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b0005-e383-43b3-97a5-26c68961450e None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:11.577214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b0005-e383-43b3-97a5-26c68961450e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:11.578976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b0005-e383-43b3-97a5-26c68961450e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:11.589112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 309/611] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:11.594227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada785-7303-4d03-8234-9fc706ef73df None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:11.723941 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091657ef-a06f-44f0-be5f-7b4daecf9d09 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:11.724268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091657ef-a06f-44f0-be5f-7b4daecf9d09 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:11.724503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091657ef-a06f-44f0-be5f-7b4daecf9d09 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:11.726132 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 310/612] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:11.731227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048ac01-d31d-4ede-93a4-24b94b499d3e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:11.731759 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048ac01-d31d-4ede-93a4-24b94b499d3e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:11.732255 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048ac01-d31d-4ede-93a4-24b94b499d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:11.759708 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:11.761528 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2048ac01-d31d-4ede-93a4-24b94b499d3e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:11.763732 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2048ac01-d31d-4ede-93a4-24b94b499d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:11.770444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada785-7303-4d03-8234-9fc706ef73df None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:11.792926 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:11.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402c3a6-4682-4a41-85cc-786b4a17008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:11.838583 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402c3a6-4682-4a41-85cc-786b4a17008f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:11.839015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402c3a6-4682-4a41-85cc-786b4a17008f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:11.839438 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402c3a6-4682-4a41-85cc-786b4a17008f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:11.855049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402c3a6-4682-4a41-85cc-786b4a17008f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:11.857737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402c3a6-4682-4a41-85cc-786b4a17008f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-4402c3a6-4682-4a41-85cc-786b4a17008f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:11.882892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:11.884002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:11.885114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:11.885114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:11.885114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:11.885114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:11.889125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 311/613] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:11.890819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 303/614] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:11.901971 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048ac01-d31d-4ede-93a4-24b94b499d3e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:11.914087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402c3a6-4682-4a41-85cc-786b4a17008f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:12.052563 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402c3a6-4682-4a41-85cc-786b4a17008f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:12.104852 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048ac01-d31d-4ede-93a4-24b94b499d3e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:12.107394 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5256d-68e9-49d2-b573-bf839d5a6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:12.108207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5256d-68e9-49d2-b573-bf839d5a6416 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:12.108487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5256d-68e9-49d2-b573-bf839d5a6416 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:12.108759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5256d-68e9-49d2-b573-bf839d5a6416 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:12.130328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5256d-68e9-49d2-b573-bf839d5a6416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d5b5256d-68e9-49d2-b573-bf839d5a6416 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:12.141138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:12.142056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:12.142878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:12.144254 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 304/615] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:12.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5256d-68e9-49d2-b573-bf839d5a6416 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:12.166101 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c8c92-8fe4-433f-b12e-b0a7298da11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:12.166766 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c8c92-8fe4-433f-b12e-b0a7298da11d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:12.167054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c8c92-8fe4-433f-b12e-b0a7298da11d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:12.167329 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c8c92-8fe4-433f-b12e-b0a7298da11d None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:12.168051 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c8c92-8fe4-433f-b12e-b0a7298da11d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:12.168358 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c8c92-8fe4-433f-b12e-b0a7298da11d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:12.170025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c8c92-8fe4-433f-b12e-b0a7298da11d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:12.173554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:12.190121 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 312/616] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:12.196288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c8c92-8fe4-433f-b12e-b0a7298da11d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:12.211820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:12.350430 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5256d-68e9-49d2-b573-bf839d5a6416 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:12.370358 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c8c92-8fe4-433f-b12e-b0a7298da11d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:12.398672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbb226-fa12-4c34-bde6-b5553660a2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:12.399801 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb226-fa12-4c34-bde6-b5553660a2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:12.400343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb226-fa12-4c34-bde6-b5553660a2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:12.400791 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb226-fa12-4c34-bde6-b5553660a2a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:12.401837 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbb226-fa12-4c34-bde6-b5553660a2a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:12.402147 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbb226-fa12-4c34-bde6-b5553660a2a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:12.404617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbb226-fa12-4c34-bde6-b5553660a2a0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:12.408953 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa4595-4a44-419e-a7ec-2cdf216bf1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:12.410361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa4595-4a44-419e-a7ec-2cdf216bf1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:12.410709 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa4595-4a44-419e-a7ec-2cdf216bf1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:12.411528 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa4595-4a44-419e-a7ec-2cdf216bf1b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:12.414851 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 305/617] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:12.416295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c23a6-929d-481a-b9a2-7eeb77d62749 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:12.416656 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c23a6-929d-481a-b9a2-7eeb77d62749 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:12.417025 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c23a6-929d-481a-b9a2-7eeb77d62749 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:12.418726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 306/618] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:12.422498 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c23a6-929d-481a-b9a2-7eeb77d62749 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:12.428478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa4595-4a44-419e-a7ec-2cdf216bf1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:12.430039 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa4595-4a44-419e-a7ec-2cdf216bf1b1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-2caa4595-4a44-419e-a7ec-2cdf216bf1b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:12.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:12.446287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:12.447664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:12.447664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:12.447664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:12.447664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:12.447664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:12.447664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:12.447664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:12.447664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:12.447664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:12.447664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:12.447664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 313/619] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:12.448315 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9469af-5f2c-41b7-a715-e05e5e96369a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:12.448315 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9469af-5f2c-41b7-a715-e05e5e96369a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:12.448682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9469af-5f2c-41b7-a715-e05e5e96369a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:12.470212 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8a9469af-5f2c-41b7-a715-e05e5e96369a None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:12.471422 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8a9469af-5f2c-41b7-a715-e05e5e96369a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:12.498642 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:12.533492 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c23a6-929d-481a-b9a2-7eeb77d62749 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:12.546069 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:12.556928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 314/620] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:12.556928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9469af-5f2c-41b7-a715-e05e5e96369a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:12.580498 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932017b-1463-48a6-bede-804f45128ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:12.581496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932017b-1463-48a6-bede-804f45128ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:12.582370 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932017b-1463-48a6-bede-804f45128ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:12.582705 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932017b-1463-48a6-bede-804f45128ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:12.598216 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932017b-1463-48a6-bede-804f45128ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:12.600971 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932017b-1463-48a6-bede-804f45128ad9 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8932017b-1463-48a6-bede-804f45128ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:12.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:12.624377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:12.625266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:12.625266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:12.625266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:12.625266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:12.625508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 307/621] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:12.626915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932017b-1463-48a6-bede-804f45128ad9 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:12.684122 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9469af-5f2c-41b7-a715-e05e5e96369a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:12.720289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080f5fd-82f2-4847-8409-7cfb70a296c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:12.721136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080f5fd-82f2-4847-8409-7cfb70a296c6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:12.721524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080f5fd-82f2-4847-8409-7cfb70a296c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:12.721969 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080f5fd-82f2-4847-8409-7cfb70a296c6 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:12.723488 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080f5fd-82f2-4847-8409-7cfb70a296c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:12.723902 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080f5fd-82f2-4847-8409-7cfb70a296c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:12.725660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080f5fd-82f2-4847-8409-7cfb70a296c6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:12.744602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 315/622] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 10:02:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:12.745583 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080f5fd-82f2-4847-8409-7cfb70a296c6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:12.771383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932017b-1463-48a6-bede-804f45128ad9 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:12.802410 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:12.806378 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:12.819292 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ba87-822f-4514-82dd-67ad7289b4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:12.820581 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ba87-822f-4514-82dd-67ad7289b4ae None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:12.820868 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ba87-822f-4514-82dd-67ad7289b4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:12.821267 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ba87-822f-4514-82dd-67ad7289b4ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:12.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6ba87-822f-4514-82dd-67ad7289b4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-16d6ba87-822f-4514-82dd-67ad7289b4ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:12.843945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:12.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 308/623] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:12.847628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ba87-822f-4514-82dd-67ad7289b4ae None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:12.864528 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080f5fd-82f2-4847-8409-7cfb70a296c6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:12.902684 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfbc0f-a95a-4e50-a4dc-d360a8b98a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:12.903509 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfbc0f-a95a-4e50-a4dc-d360a8b98a4e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:12.903967 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfbc0f-a95a-4e50-a4dc-d360a8b98a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:12.904342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfbc0f-a95a-4e50-a4dc-d360a8b98a4e None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:12.905194 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfbc0f-a95a-4e50-a4dc-d360a8b98a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:12.905601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfbc0f-a95a-4e50-a4dc-d360a8b98a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:12.907330 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfbc0f-a95a-4e50-a4dc-d360a8b98a4e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:12.920338 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 316/624] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:12.921512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfbc0f-a95a-4e50-a4dc-d360a8b98a4e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:12.971966 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ba87-822f-4514-82dd-67ad7289b4ae None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:13.015451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9373f2-b2e3-4a4c-8adb-306d399f1a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:13.016607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9373f2-b2e3-4a4c-8adb-306d399f1a00 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.016932 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9373f2-b2e3-4a4c-8adb-306d399f1a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.017230 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9373f2-b2e3-4a4c-8adb-306d399f1a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.031874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9373f2-b2e3-4a4c-8adb-306d399f1a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:13.033303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfbc0f-a95a-4e50-a4dc-d360a8b98a4e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:13.033426 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9373f2-b2e3-4a4c-8adb-306d399f1a00 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-bf9373f2-b2e3-4a4c-8adb-306d399f1a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:13.052675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:13.054372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:13.056444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:13.056444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:13.056444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:13.056444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:13.056444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 309/625] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:13.057206 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:13.057351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9373f2-b2e3-4a4c-8adb-306d399f1a00 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:13.085120 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1163d-3637-4718-a8c7-5eb7d3bb644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:13.085801 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1163d-3637-4718-a8c7-5eb7d3bb644d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.086647 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1163d-3637-4718-a8c7-5eb7d3bb644d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.086934 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1163d-3637-4718-a8c7-5eb7d3bb644d None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.087965 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1163d-3637-4718-a8c7-5eb7d3bb644d None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:13.088282 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1163d-3637-4718-a8c7-5eb7d3bb644d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:13.090342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1163d-3637-4718-a8c7-5eb7d3bb644d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:13.099499 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:13.107920 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 317/626] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:13.108816 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1163d-3637-4718-a8c7-5eb7d3bb644d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:13.172873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9373f2-b2e3-4a4c-8adb-306d399f1a00 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:13.209087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f756b9-eb5b-4f18-9fe9-3c39b04c32e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:13.210009 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f756b9-eb5b-4f18-9fe9-3c39b04c32e0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.210359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f756b9-eb5b-4f18-9fe9-3c39b04c32e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.210704 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f756b9-eb5b-4f18-9fe9-3c39b04c32e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.218662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f756b9-eb5b-4f18-9fe9-3c39b04c32e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:13.220249 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f756b9-eb5b-4f18-9fe9-3c39b04c32e0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:13.235451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1163d-3637-4718-a8c7-5eb7d3bb644d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-83f756b9-eb5b-4f18-9fe9-3c39b04c32e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:13.236040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:13.238517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 310/627] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 10:02:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:13.240086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f756b9-eb5b-4f18-9fe9-3c39b04c32e0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:13.280334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c47e1-87ac-4245-8a1b-74d9fdd62bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:13.281094 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c47e1-87ac-4245-8a1b-74d9fdd62bfa None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.281379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c47e1-87ac-4245-8a1b-74d9fdd62bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.281655 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c47e1-87ac-4245-8a1b-74d9fdd62bfa None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.282810 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c47e1-87ac-4245-8a1b-74d9fdd62bfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:13.283116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c47e1-87ac-4245-8a1b-74d9fdd62bfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:13.284539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c47e1-87ac-4245-8a1b-74d9fdd62bfa None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:13.305072 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 318/628] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:13.305971 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c47e1-87ac-4245-8a1b-74d9fdd62bfa None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:13.357266 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:13.366708 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:13.375924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f756b9-eb5b-4f18-9fe9-3c39b04c32e0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:13.417512 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5ee55-ca55-43d9-9ba6-e63a5904ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:13.418312 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5ee55-ca55-43d9-9ba6-e63a5904ef7b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.418596 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5ee55-ca55-43d9-9ba6-e63a5904ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.419033 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5ee55-ca55-43d9-9ba6-e63a5904ef7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.425054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c47e1-87ac-4245-8a1b-74d9fdd62bfa None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:13.430532 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5ee55-ca55-43d9-9ba6-e63a5904ef7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:13.431991 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5ee55-ca55-43d9-9ba6-e63a5904ef7b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-06b5ee55-ca55-43d9-9ba6-e63a5904ef7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:13.449651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:13.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:13.451538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:13.451538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:13.451538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:13.451538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:13.451538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 311/629] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:13.451842 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5ee55-ca55-43d9-9ba6-e63a5904ef7b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:13.466622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c9f89-cc75-40ec-8e44-36adf3e9fe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:13.467304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9f89-cc75-40ec-8e44-36adf3e9fe6f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.467593 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9f89-cc75-40ec-8e44-36adf3e9fe6f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.467879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9f89-cc75-40ec-8e44-36adf3e9fe6f None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.468756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c9f89-cc75-40ec-8e44-36adf3e9fe6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:13.469118 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c9f89-cc75-40ec-8e44-36adf3e9fe6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:13.470549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c9f89-cc75-40ec-8e44-36adf3e9fe6f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:13.487835 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 319/630] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 10:02:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:13.489729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad269b-97d1-4eb2-baf4-5894d1ec383e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.490028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad269b-97d1-4eb2-baf4-5894d1ec383e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.490311 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad269b-97d1-4eb2-baf4-5894d1ec383e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.495891 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 320/631] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:13.496699 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad269b-97d1-4eb2-baf4-5894d1ec383e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:13.556199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5ee55-ca55-43d9-9ba6-e63a5904ef7b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:13.593887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bc66c-4914-4fc3-b345-d3206b281d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:13.594733 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bc66c-4914-4fc3-b345-d3206b281d24 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.595022 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bc66c-4914-4fc3-b345-d3206b281d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.595295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bc66c-4914-4fc3-b345-d3206b281d24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.599199 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:13.602694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bc66c-4914-4fc3-b345-d3206b281d24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:13.604149 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bc66c-4914-4fc3-b345-d3206b281d24 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:13.606298 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad269b-97d1-4eb2-baf4-5894d1ec383e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-a86bc66c-4914-4fc3-b345-d3206b281d24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:13.619691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:13.620884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:13.621815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:13.621815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:13.621815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:13.621815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:13.621815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:13.621815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:13.621815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:13.621815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:13.621815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 312/632] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:13.622305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bc66c-4914-4fc3-b345-d3206b281d24 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:13.630397 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:13.643291 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2d0b7-95c1-4d70-bfb5-e9c5c527fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:13.643954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d0b7-95c1-4d70-bfb5-e9c5c527fd25 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.644236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d0b7-95c1-4d70-bfb5-e9c5c527fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.644511 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d0b7-95c1-4d70-bfb5-e9c5c527fd25 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.645254 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2d0b7-95c1-4d70-bfb5-e9c5c527fd25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:13.645560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2d0b7-95c1-4d70-bfb5-e9c5c527fd25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:13.646919 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2d0b7-95c1-4d70-bfb5-e9c5c527fd25 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:13.657893 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 321/633] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:13.659051 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0fbbf-3bf3-4739-8557-cd5ac8536dcc None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.659342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0fbbf-3bf3-4739-8557-cd5ac8536dcc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.659628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0fbbf-3bf3-4739-8557-cd5ac8536dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.676270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-91d0fbbf-3bf3-4739-8557-cd5ac8536dcc None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:13.677414 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-91d0fbbf-3bf3-4739-8557-cd5ac8536dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:13.720386 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bc66c-4914-4fc3-b345-d3206b281d24 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:13.744575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 322/634] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:13.745745 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def089e5-f9b1-4176-97e8-842854cfa942 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.746033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def089e5-f9b1-4176-97e8-842854cfa942 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.746310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def089e5-f9b1-4176-97e8-842854cfa942 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.747560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 323/635] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:13.748242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def089e5-f9b1-4176-97e8-842854cfa942 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:13.762239 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7ea93-9e41-42b0-994c-548a5b884d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:13.762884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7ea93-9e41-42b0-994c-548a5b884d38 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.763163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7ea93-9e41-42b0-994c-548a5b884d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.763437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7ea93-9e41-42b0-994c-548a5b884d38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.828487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7ea93-9e41-42b0-994c-548a5b884d38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:13.829962 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7ea93-9e41-42b0-994c-548a5b884d38 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:13.835525 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:13.837649 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:13.851545 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def089e5-f9b1-4176-97e8-842854cfa942 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:13.884209 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3baa6-875a-4984-856c-f78b7a3e0407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:13.884945 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3baa6-875a-4984-856c-f78b7a3e0407 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.885233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3baa6-875a-4984-856c-f78b7a3e0407 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.885510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3baa6-875a-4984-856c-f78b7a3e0407 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.886287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3baa6-875a-4984-856c-f78b7a3e0407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:13.886593 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3baa6-875a-4984-856c-f78b7a3e0407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:13.888025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3baa6-875a-4984-856c-f78b7a3e0407 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:13.899113 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 324/636] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:13.899893 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3baa6-875a-4984-856c-f78b7a3e0407 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:13.931177 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 313/637] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:13.932377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3fdd4-5e5f-4667-af40-7c86fd518add None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:13.932666 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3fdd4-5e5f-4667-af40-7c86fd518add None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:13.932974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3fdd4-5e5f-4667-af40-7c86fd518add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:13.948447 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-fff3fdd4-5e5f-4667-af40-7c86fd518add None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:13.949684 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fff3fdd4-5e5f-4667-af40-7c86fd518add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:13.999533 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3baa6-875a-4984-856c-f78b7a3e0407 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:14.017066 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 314/638] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:14.018364 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3fdd4-5e5f-4667-af40-7c86fd518add None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:14.041422 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30840c-8a06-43c3-b2d7-1560d56c5f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:14.042226 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30840c-8a06-43c3-b2d7-1560d56c5f9a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:14.042505 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30840c-8a06-43c3-b2d7-1560d56c5f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:14.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30840c-8a06-43c3-b2d7-1560d56c5f9a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:14.051231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30840c-8a06-43c3-b2d7-1560d56c5f9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:14.052647 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30840c-8a06-43c3-b2d7-1560d56c5f9a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:14.052967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4b30840c-8a06-43c3-b2d7-1560d56c5f9a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:14.067475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:14.068633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 325/639] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:14.069637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30840c-8a06-43c3-b2d7-1560d56c5f9a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:14.077757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:14.119810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3fdd4-5e5f-4667-af40-7c86fd518add None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:14.153194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dd9c0-e3e7-4f4a-b9ba-a18ae51aee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:14.153983 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dd9c0-e3e7-4f4a-b9ba-a18ae51aee47 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:14.154268 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dd9c0-e3e7-4f4a-b9ba-a18ae51aee47 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:14.154547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dd9c0-e3e7-4f4a-b9ba-a18ae51aee47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:14.164252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dd9c0-e3e7-4f4a-b9ba-a18ae51aee47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:14.167577 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30840c-8a06-43c3-b2d7-1560d56c5f9a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1b1dd9c0-e3e7-4f4a-b9ba-a18ae51aee47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:14.172222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:14.173771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 315/640] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:14.174593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dd9c0-e3e7-4f4a-b9ba-a18ae51aee47 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:14.202838 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d5f1f-679e-428b-aed0-d91d685854bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:14.203650 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5f1f-679e-428b-aed0-d91d685854bd None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:14.203935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5f1f-679e-428b-aed0-d91d685854bd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:14.204224 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5f1f-679e-428b-aed0-d91d685854bd None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/1167f58a1ea3465083d67a94043066be/roles/0fa7c8540d8b472aace10fb2fc38b37b` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:14.218331 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d5f1f-679e-428b-aed0-d91d685854bd None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=1167f58a1ea3465083d67a94043066be, role_id=0fa7c8540d8b472aace10fb2fc38b37b)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:14.219767 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d5f1f-679e-428b-aed0-d91d685854bd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:14.231691 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 326/641] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:02:14 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/1167f58a1ea3465083d67a94043066be/roles/0fa7c8540d8b472aace10fb2fc38b37b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:02:14.232477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d5f1f-679e-428b-aed0-d91d685854bd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:14.283032 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:14.294598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dd9c0-e3e7-4f4a-b9ba-a18ae51aee47 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:14.305675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:14.334013 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385198d-c1c4-4d5c-bb14-80d8693152de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:14.334826 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385198d-c1c4-4d5c-bb14-80d8693152de None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:14.335108 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385198d-c1c4-4d5c-bb14-80d8693152de None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:14.335382 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385198d-c1c4-4d5c-bb14-80d8693152de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:14.348649 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385198d-c1c4-4d5c-bb14-80d8693152de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:14.350175 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385198d-c1c4-4d5c-bb14-80d8693152de None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:14.359612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d5f1f-679e-428b-aed0-d91d685854bd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d385198d-c1c4-4d5c-bb14-80d8693152de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:14.369079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:14.370094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:14.370972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:14.370972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:14.370972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:14.370972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:14.370972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 316/642] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:14.371264 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385198d-c1c4-4d5c-bb14-80d8693152de None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:14.403879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db2086-85f1-402d-a9a2-484355c90bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:14.404685 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db2086-85f1-402d-a9a2-484355c90bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:14.405014 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db2086-85f1-402d-a9a2-484355c90bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:14.405303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db2086-85f1-402d-a9a2-484355c90bd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:14.417176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db2086-85f1-402d-a9a2-484355c90bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d4db2086-85f1-402d-a9a2-484355c90bd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:14.425267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:14.426740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 327/643] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:14.428029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db2086-85f1-402d-a9a2-484355c90bd6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:14.485317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385198d-c1c4-4d5c-bb14-80d8693152de None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:14.519703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad589ead-bfae-445c-98ac-3264927a52d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:14.520411 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad589ead-bfae-445c-98ac-3264927a52d0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:14.520659 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad589ead-bfae-445c-98ac-3264927a52d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:14.520964 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad589ead-bfae-445c-98ac-3264927a52d0 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:14.521799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad589ead-bfae-445c-98ac-3264927a52d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:14.522113 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad589ead-bfae-445c-98ac-3264927a52d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:14.523546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad589ead-bfae-445c-98ac-3264927a52d0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:14.531513 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db2086-85f1-402d-a9a2-484355c90bd6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:14.543394 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 317/644] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 10:02:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:14.544533 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad589ead-bfae-445c-98ac-3264927a52d0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:14.553762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:14.555701 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:14.575761 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da60bd-35df-4198-9138-aca18f82facb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:14.576591 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da60bd-35df-4198-9138-aca18f82facb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:14.576877 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da60bd-35df-4198-9138-aca18f82facb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:14.577182 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da60bd-35df-4198-9138-aca18f82facb None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:14.577925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da60bd-35df-4198-9138-aca18f82facb None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:14.578433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da60bd-35df-4198-9138-aca18f82facb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:14.579613 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da60bd-35df-4198-9138-aca18f82facb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:14.588653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 328/645] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:14.593739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da60bd-35df-4198-9138-aca18f82facb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:14.650254 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad589ead-bfae-445c-98ac-3264927a52d0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:14.688020 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62c7f1-288a-46e2-9ff8-02a00605bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:14.688697 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c7f1-288a-46e2-9ff8-02a00605bcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:14.689174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c7f1-288a-46e2-9ff8-02a00605bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:14.689458 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c7f1-288a-46e2-9ff8-02a00605bcc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:14.690657 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62c7f1-288a-46e2-9ff8-02a00605bcc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:14.691156 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62c7f1-288a-46e2-9ff8-02a00605bcc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:14.693652 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62c7f1-288a-46e2-9ff8-02a00605bcc0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:14.698997 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da60bd-35df-4198-9138-aca18f82facb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:14.707201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 318/646] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:14.707947 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62c7f1-288a-46e2-9ff8-02a00605bcc0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:14.739161 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b658cb-6c44-47dd-8932-bd9a5ce6a18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:14.739765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b658cb-6c44-47dd-8932-bd9a5ce6a18c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:14.740052 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b658cb-6c44-47dd-8932-bd9a5ce6a18c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:14.740329 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b658cb-6c44-47dd-8932-bd9a5ce6a18c None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:14.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b658cb-6c44-47dd-8932-bd9a5ce6a18c None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:14.741416 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b658cb-6c44-47dd-8932-bd9a5ce6a18c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:14.742797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b658cb-6c44-47dd-8932-bd9a5ce6a18c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:14.750664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 329/647] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:14.751460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b658cb-6c44-47dd-8932-bd9a5ce6a18c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:14.783353 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:14.798795 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:14.823206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62c7f1-288a-46e2-9ff8-02a00605bcc0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:14.858063 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b7db9-d80b-4a2e-ae8f-bb66ffd73c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:14.858713 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7db9-d80b-4a2e-ae8f-bb66ffd73c3d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:14.858998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7db9-d80b-4a2e-ae8f-bb66ffd73c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:14.859278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7db9-d80b-4a2e-ae8f-bb66ffd73c3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:14.860389 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b658cb-6c44-47dd-8932-bd9a5ce6a18c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:14.897455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3111b4d-f011-46b4-b337-c2c7545f701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:14.898251 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3111b4d-f011-46b4-b337-c2c7545f701c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:14.898544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3111b4d-f011-46b4-b337-c2c7545f701c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:14.898982 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3111b4d-f011-46b4-b337-c2c7545f701c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:14.911579 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3111b4d-f011-46b4-b337-c2c7545f701c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:14.913064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3111b4d-f011-46b4-b337-c2c7545f701c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e3111b4d-f011-46b4-b337-c2c7545f701c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:14.931336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:14.932234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:14.933554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:14.933554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:14.933554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:14.933554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:14.933554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 330/648] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:14.933554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3111b4d-f011-46b4-b337-c2c7545f701c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:14.938976 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b7db9-d80b-4a2e-ae8f-bb66ffd73c3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:14.940440 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b7db9-d80b-4a2e-ae8f-bb66ffd73c3d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:15.012060 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:15.028281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:15.038304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3111b4d-f011-46b4-b337-c2c7545f701c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:15.051275 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 319/649] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:15.051930 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b7db9-d80b-4a2e-ae8f-bb66ffd73c3d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:15.081370 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109a1d6-907d-4fde-aec3-be05f6772585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:15.083076 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109a1d6-907d-4fde-aec3-be05f6772585 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:15.083592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109a1d6-907d-4fde-aec3-be05f6772585 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:15.084097 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109a1d6-907d-4fde-aec3-be05f6772585 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:15.091239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109a1d6-907d-4fde-aec3-be05f6772585 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:15.092799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109a1d6-907d-4fde-aec3-be05f6772585 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c109a1d6-907d-4fde-aec3-be05f6772585 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:15.107769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:15.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:15.109622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:15.109622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:15.109622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:15.109622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:15.109622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:15.109622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:15.109622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:15.109622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:15.109622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 331/650] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:15.110836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109a1d6-907d-4fde-aec3-be05f6772585 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:15.162234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b7db9-d80b-4a2e-ae8f-bb66ffd73c3d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:15.200324 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cb610-4d10-4100-945f-2c5d820e4108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:15.201845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cb610-4d10-4100-945f-2c5d820e4108 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:15.202309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cb610-4d10-4100-945f-2c5d820e4108 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:15.202590 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cb610-4d10-4100-945f-2c5d820e4108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:15.210870 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109a1d6-907d-4fde-aec3-be05f6772585 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:15.213255 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cb610-4d10-4100-945f-2c5d820e4108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:15.214993 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cb610-4d10-4100-945f-2c5d820e4108 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-465cb610-4d10-4100-945f-2c5d820e4108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:15.233259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:15.234176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:15.235055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:15.235055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:15.235055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:15.235055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:15.235055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 320/651] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:15.235347 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cb610-4d10-4100-945f-2c5d820e4108 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:15.250589 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c208f71-88b8-442f-ba0c-af1ff5a011f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:15.251261 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c208f71-88b8-442f-ba0c-af1ff5a011f8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:15.251540 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c208f71-88b8-442f-ba0c-af1ff5a011f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:15.251822 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c208f71-88b8-442f-ba0c-af1ff5a011f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:15.252597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c208f71-88b8-442f-ba0c-af1ff5a011f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:15.252839 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c208f71-88b8-442f-ba0c-af1ff5a011f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:15.254234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c208f71-88b8-442f-ba0c-af1ff5a011f8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:15.258494 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:15.266557 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 332/652] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:15.267438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c208f71-88b8-442f-ba0c-af1ff5a011f8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:15.283155 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:15.358504 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cb610-4d10-4100-945f-2c5d820e4108 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:15.380840 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c208f71-88b8-442f-ba0c-af1ff5a011f8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:15.392997 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8e4b6-ee9d-4895-bdd8-030f3102f8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:15.393795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8e4b6-ee9d-4895-bdd8-030f3102f8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:15.394091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8e4b6-ee9d-4895-bdd8-030f3102f8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:15.394402 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8e4b6-ee9d-4895-bdd8-030f3102f8e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:15.404959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8e4b6-ee9d-4895-bdd8-030f3102f8e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:15.406414 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8e4b6-ee9d-4895-bdd8-030f3102f8e9 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:15.417976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a89466-1ff3-4a97-9c7c-78b133d1a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:15.418643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89466-1ff3-4a97-9c7c-78b133d1a199 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:15.418929 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89466-1ff3-4a97-9c7c-78b133d1a199 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:15.419461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89466-1ff3-4a97-9c7c-78b133d1a199 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:15.420238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a89466-1ff3-4a97-9c7c-78b133d1a199 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:15.420553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a89466-1ff3-4a97-9c7c-78b133d1a199 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:15.422007 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a89466-1ff3-4a97-9c7c-78b133d1a199 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-54c8e4b6-ee9d-4895-bdd8-030f3102f8e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:15.424506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:15.425525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:15.427048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:15.427048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:15.427048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:15.427048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:15.427048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 321/653] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:15.427394 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8e4b6-ee9d-4895-bdd8-030f3102f8e9 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:15.438865 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 333/654] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:15.440427 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a89466-1ff3-4a97-9c7c-78b133d1a199 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:15.502917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:15.517146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:15.536344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8e4b6-ee9d-4895-bdd8-030f3102f8e9 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:15.553842 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a89466-1ff3-4a97-9c7c-78b133d1a199 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:15.571237 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e1e1f-5904-4451-b51a-e1ecf636af2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:15.571896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e1e1f-5904-4451-b51a-e1ecf636af2d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:15.572177 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e1e1f-5904-4451-b51a-e1ecf636af2d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:15.572450 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e1e1f-5904-4451-b51a-e1ecf636af2d None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:15.573176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e1e1f-5904-4451-b51a-e1ecf636af2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:15.573483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e1e1f-5904-4451-b51a-e1ecf636af2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:15.574833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e1e1f-5904-4451-b51a-e1ecf636af2d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:15.587812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 322/655] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:15.588698 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e1e1f-5904-4451-b51a-e1ecf636af2d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:15.596103 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3903a74-7184-40b8-874b-ae8048e3403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:15.596931 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903a74-7184-40b8-874b-ae8048e3403f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:15.597211 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903a74-7184-40b8-874b-ae8048e3403f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:15.598049 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903a74-7184-40b8-874b-ae8048e3403f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:15.605993 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3903a74-7184-40b8-874b-ae8048e3403f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:15.607440 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3903a74-7184-40b8-874b-ae8048e3403f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-b3903a74-7184-40b8-874b-ae8048e3403f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:15.623720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:15.624625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:15.625592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:15.625592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:15.625592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:15.625592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:15.625592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:15.625592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:15.625592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:15.625592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:15.625592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 10:02:15.625592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:15.625592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 334/656] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:15.626185 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3903a74-7184-40b8-874b-ae8048e3403f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:15.698940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e1e1f-5904-4451-b51a-e1ecf636af2d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:15.728343 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3903a74-7184-40b8-874b-ae8048e3403f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:15.730304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:15.736955 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c49a0-46cd-4c77-9078-f1bfed1819ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:15.737628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c49a0-46cd-4c77-9078-f1bfed1819ab None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:15.737943 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c49a0-46cd-4c77-9078-f1bfed1819ab None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:15.738231 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c49a0-46cd-4c77-9078-f1bfed1819ab None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:15.738949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c49a0-46cd-4c77-9078-f1bfed1819ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:15.739261 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c49a0-46cd-4c77-9078-f1bfed1819ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:15.740638 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c49a0-46cd-4c77-9078-f1bfed1819ab None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:15.757144 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 323/657] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:15.758003 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c49a0-46cd-4c77-9078-f1bfed1819ab None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:15.759135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:15.765907 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27c62c-a286-40cb-928a-7171c95bd417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:15.766570 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27c62c-a286-40cb-928a-7171c95bd417 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:15.766858 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27c62c-a286-40cb-928a-7171c95bd417 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:15.767610 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27c62c-a286-40cb-928a-7171c95bd417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:15.768397 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27c62c-a286-40cb-928a-7171c95bd417 None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=1ff81129f179478d901b590a5be64f38) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:15.768721 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27c62c-a286-40cb-928a-7171c95bd417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:15.771372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27c62c-a286-40cb-928a-7171c95bd417 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:15.788921 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 335/658] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:15 2022] GET /identity/v3/role_assignments?user.id=1ff81129f179478d901b590a5be64f38&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:15.788921 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27c62c-a286-40cb-928a-7171c95bd417 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:15.874663 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c49a0-46cd-4c77-9078-f1bfed1819ab None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:15.914175 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4022be8-dfd9-4534-a2e5-fab930f18f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:15.915496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4022be8-dfd9-4534-a2e5-fab930f18f8a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:15.915838 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4022be8-dfd9-4534-a2e5-fab930f18f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:15.916177 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4022be8-dfd9-4534-a2e5-fab930f18f8a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:15.928006 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4022be8-dfd9-4534-a2e5-fab930f18f8a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:15.930343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4022be8-dfd9-4534-a2e5-fab930f18f8a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:15.934145 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27c62c-a286-40cb-928a-7171c95bd417 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-c4022be8-dfd9-4534-a2e5-fab930f18f8a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:15.949203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:15.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 324/659] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:15.952547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4022be8-dfd9-4534-a2e5-fab930f18f8a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:15.985664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ff7a7-8cef-4f31-a4e3-2d4fb5f1f65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:15.986341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ff7a7-8cef-4f31-a4e3-2d4fb5f1f65c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:15.986625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ff7a7-8cef-4f31-a4e3-2d4fb5f1f65c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:15.986901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ff7a7-8cef-4f31-a4e3-2d4fb5f1f65c None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:15.988631 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ff7a7-8cef-4f31-a4e3-2d4fb5f1f65c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:15.988631 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ff7a7-8cef-4f31-a4e3-2d4fb5f1f65c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:15.989581 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ff7a7-8cef-4f31-a4e3-2d4fb5f1f65c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:16.011561 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 336/660] 10.222.0.13 () {56 vars in 1139 bytes} [Tue Jul 5 10:02:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:16.012412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ff7a7-8cef-4f31-a4e3-2d4fb5f1f65c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:16.013467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:16.080770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4022be8-dfd9-4534-a2e5-fab930f18f8a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:16.096398 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:16.121566 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7ac3-3304-48f6-ab7e-5ab51e3e9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:16.122677 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7ac3-3304-48f6-ab7e-5ab51e3e9180 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:16.123215 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7ac3-3304-48f6-ab7e-5ab51e3e9180 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:16.124254 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7ac3-3304-48f6-ab7e-5ab51e3e9180 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:16.135491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd7ac3-3304-48f6-ab7e-5ab51e3e9180 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:16.137203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd7ac3-3304-48f6-ab7e-5ab51e3e9180 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:16.137547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ff7a7-8cef-4f31-a4e3-2d4fb5f1f65c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8fdd7ac3-3304-48f6-ab7e-5ab51e3e9180 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:16.157361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:16.158297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:16.159247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:16.159247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:16.159247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:16.159247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:16.159247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:16.159247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:16.159247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:16.159247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:16.162177 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 325/661] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:16.164936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7ac3-3304-48f6-ab7e-5ab51e3e9180 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:16.176845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401d5b5-5fe1-4367-a6e0-eed4aa7b293f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:16.177746 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401d5b5-5fe1-4367-a6e0-eed4aa7b293f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:16.178126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401d5b5-5fe1-4367-a6e0-eed4aa7b293f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:16.178529 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401d5b5-5fe1-4367-a6e0-eed4aa7b293f None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:16.179468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401d5b5-5fe1-4367-a6e0-eed4aa7b293f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:16.179883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401d5b5-5fe1-4367-a6e0-eed4aa7b293f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:16.181450 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401d5b5-5fe1-4367-a6e0-eed4aa7b293f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:16.200332 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 337/662] 10.222.0.13 () {56 vars in 1137 bytes} [Tue Jul 5 10:02:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:16.201423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401d5b5-5fe1-4367-a6e0-eed4aa7b293f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:16.272912 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7ac3-3304-48f6-ab7e-5ab51e3e9180 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:16.285237 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:16.310794 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401d5b5-5fe1-4367-a6e0-eed4aa7b293f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:16.314118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3707a63-ee36-4070-adf3-1a9556fe7eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:16.314770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3707a63-ee36-4070-adf3-1a9556fe7eae None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:16.315051 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3707a63-ee36-4070-adf3-1a9556fe7eae None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:16.315334 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3707a63-ee36-4070-adf3-1a9556fe7eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:16.325106 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:16.347258 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a23db4-906d-4a06-a847-2825952b30cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:16.347867 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a23db4-906d-4a06-a847-2825952b30cf None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:16.348153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a23db4-906d-4a06-a847-2825952b30cf None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:16.348430 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a23db4-906d-4a06-a847-2825952b30cf None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:16.349250 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a23db4-906d-4a06-a847-2825952b30cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:16.349560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a23db4-906d-4a06-a847-2825952b30cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:16.350996 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a23db4-906d-4a06-a847-2825952b30cf None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:16.362758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 338/663] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:16.364679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a23db4-906d-4a06-a847-2825952b30cf None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:16.391235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3707a63-ee36-4070-adf3-1a9556fe7eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:16.392810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3707a63-ee36-4070-adf3-1a9556fe7eae None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:16.468076 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a23db4-906d-4a06-a847-2825952b30cf None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:16.500300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 326/664] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:16.500872 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96462e27-d195-42f8-b871-f7e1875bb115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:16.501619 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96462e27-d195-42f8-b871-f7e1875bb115 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:16.501821 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053776b-72ed-409b-8c9e-23dd8d7af26b None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:16.501939 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96462e27-d195-42f8-b871-f7e1875bb115 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:16.502126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053776b-72ed-409b-8c9e-23dd8d7af26b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:16.502220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96462e27-d195-42f8-b871-f7e1875bb115 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:16.502363 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053776b-72ed-409b-8c9e-23dd8d7af26b None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:16.508163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 327/665] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:16.508163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053776b-72ed-409b-8c9e-23dd8d7af26b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:16.517806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:16.552688 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:16.581366 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96462e27-d195-42f8-b871-f7e1875bb115 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:16.582854 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96462e27-d195-42f8-b871-f7e1875bb115 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:16.610902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053776b-72ed-409b-8c9e-23dd8d7af26b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:16.645183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765bbbb-2a1a-4a69-8e57-8649aba7fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:16.645837 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765bbbb-2a1a-4a69-8e57-8649aba7fa56 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:16.646118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765bbbb-2a1a-4a69-8e57-8649aba7fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:16.646390 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765bbbb-2a1a-4a69-8e57-8649aba7fa56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:16.647212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765bbbb-2a1a-4a69-8e57-8649aba7fa56 None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=a7d1be247c09473ab5f4ac224347a359) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:16.647520 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765bbbb-2a1a-4a69-8e57-8649aba7fa56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:16.648961 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765bbbb-2a1a-4a69-8e57-8649aba7fa56 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:16.654856 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 328/666] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:16 2022] GET /identity/v3/role_assignments?user.id=a7d1be247c09473ab5f4ac224347a359&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:16.657850 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765bbbb-2a1a-4a69-8e57-8649aba7fa56 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:16.691608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 339/667] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:16.693739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceaa0d-96ad-40da-ad5c-b120603ef37b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:16.694296 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceaa0d-96ad-40da-ad5c-b120603ef37b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:16.694779 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceaa0d-96ad-40da-ad5c-b120603ef37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:16.713105 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-17ceaa0d-96ad-40da-ad5c-b120603ef37b None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:16.714748 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-17ceaa0d-96ad-40da-ad5c-b120603ef37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:16.750728 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:16.780583 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765bbbb-2a1a-4a69-8e57-8649aba7fa56 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:16.791689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 340/668] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:16.793271 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceaa0d-96ad-40da-ad5c-b120603ef37b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:16.797957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:16.842133 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cd48b-c6d8-46db-b72d-b6eefaae92b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:16.843030 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cd48b-c6d8-46db-b72d-b6eefaae92b4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:16.843384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cd48b-c6d8-46db-b72d-b6eefaae92b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:16.843733 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cd48b-c6d8-46db-b72d-b6eefaae92b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:16.855567 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cd48b-c6d8-46db-b72d-b6eefaae92b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:16.857210 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cd48b-c6d8-46db-b72d-b6eefaae92b4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-775cd48b-c6d8-46db-b72d-b6eefaae92b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:16.876614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:16.877573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:16.878446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:16.878446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:16.878446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:16.878446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:16.878446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 329/669] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:16.878446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cd48b-c6d8-46db-b72d-b6eefaae92b4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:16.918276 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceaa0d-96ad-40da-ad5c-b120603ef37b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:16.960822 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c29155-7921-469a-929b-774f19023bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:16.962067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c29155-7921-469a-929b-774f19023bfd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:16.962067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c29155-7921-469a-929b-774f19023bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:16.962498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c29155-7921-469a-929b-774f19023bfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:16.974446 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c29155-7921-469a-929b-774f19023bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:16.975893 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c29155-7921-469a-929b-774f19023bfd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-12c29155-7921-469a-929b-774f19023bfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:16.994435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:16.995361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:16.996244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:16.996244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:16.996244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:16.996244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:16.996244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 341/670] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:16.996984 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c29155-7921-469a-929b-774f19023bfd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:17.009428 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cd48b-c6d8-46db-b72d-b6eefaae92b4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:17.041759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:17.052327 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e8d42-4006-4250-8bba-0e4b062789bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:17.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e8d42-4006-4250-8bba-0e4b062789bb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:17.054877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e8d42-4006-4250-8bba-0e4b062789bb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:17.055385 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e8d42-4006-4250-8bba-0e4b062789bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:17.057268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:17.067623 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e8d42-4006-4250-8bba-0e4b062789bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-753e8d42-4006-4250-8bba-0e4b062789bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:17.075865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:17.076804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:17.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:17.080443 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 330/671] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:17.086932 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e8d42-4006-4250-8bba-0e4b062789bb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:17.102504 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c29155-7921-469a-929b-774f19023bfd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:17.136963 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331133cf-2fef-4873-b019-9e896251a533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:17.137567 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331133cf-2fef-4873-b019-9e896251a533 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:17.137848 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331133cf-2fef-4873-b019-9e896251a533 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:17.138124 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331133cf-2fef-4873-b019-9e896251a533 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:17.138850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331133cf-2fef-4873-b019-9e896251a533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:17.139240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331133cf-2fef-4873-b019-9e896251a533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:17.140618 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331133cf-2fef-4873-b019-9e896251a533 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:17.153243 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 342/672] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:17.153972 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331133cf-2fef-4873-b019-9e896251a533 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:17.196266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e8d42-4006-4250-8bba-0e4b062789bb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:17.231946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b3f19-d90d-46b4-bb46-ffaec3a4827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:17.233044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b3f19-d90d-46b4-bb46-ffaec3a4827a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:17.233687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b3f19-d90d-46b4-bb46-ffaec3a4827a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:17.234169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b3f19-d90d-46b4-bb46-ffaec3a4827a None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:17.235088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b3f19-d90d-46b4-bb46-ffaec3a4827a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:17.235595 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b3f19-d90d-46b4-bb46-ffaec3a4827a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:17.237186 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b3f19-d90d-46b4-bb46-ffaec3a4827a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:17.250071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 331/673] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:17.251254 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b3f19-d90d-46b4-bb46-ffaec3a4827a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:17.255990 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331133cf-2fef-4873-b019-9e896251a533 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:17.272970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:17.306156 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424b1db-c288-4775-9090-3f2070262d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:17.307260 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424b1db-c288-4775-9090-3f2070262d97 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:17.307554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424b1db-c288-4775-9090-3f2070262d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:17.307838 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424b1db-c288-4775-9090-3f2070262d97 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:17.308589 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424b1db-c288-4775-9090-3f2070262d97 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:17.308931 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424b1db-c288-4775-9090-3f2070262d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:17.310685 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424b1db-c288-4775-9090-3f2070262d97 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:17.315489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:17.326822 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 343/674] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:17.327743 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424b1db-c288-4775-9090-3f2070262d97 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:17.390303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b3f19-d90d-46b4-bb46-ffaec3a4827a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:17.436477 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad9ec-c1e6-4987-b1dd-d5427691491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:17.438081 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad9ec-c1e6-4987-b1dd-d5427691491d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:17.438827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad9ec-c1e6-4987-b1dd-d5427691491d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:17.439303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad9ec-c1e6-4987-b1dd-d5427691491d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:17.449314 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ad9ec-c1e6-4987-b1dd-d5427691491d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:17.450933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424b1db-c288-4775-9090-3f2070262d97 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:17.451198 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ad9ec-c1e6-4987-b1dd-d5427691491d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-ab8ad9ec-c1e6-4987-b1dd-d5427691491d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:17.469758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:17.470710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:17.471587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:17.471587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:17.471587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:17.471587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:17.471587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:17.471587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:17.471587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:17.471587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:17.474499 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 332/675] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:17.475533 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad9ec-c1e6-4987-b1dd-d5427691491d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:17.493041 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273d2a8-e609-432a-a8bc-99dabb84fec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:17.494000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273d2a8-e609-432a-a8bc-99dabb84fec9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:17.494623 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273d2a8-e609-432a-a8bc-99dabb84fec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:17.495004 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273d2a8-e609-432a-a8bc-99dabb84fec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:17.503653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273d2a8-e609-432a-a8bc-99dabb84fec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:17.505709 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273d2a8-e609-432a-a8bc-99dabb84fec9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-1273d2a8-e609-432a-a8bc-99dabb84fec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:17.524654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:17.525671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:17.526628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:17.526628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:17.526628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:17.526628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:17.526628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:17.526628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:17.526628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:17.526628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:17.526628 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 344/676] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:17.527792 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273d2a8-e609-432a-a8bc-99dabb84fec9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:17.572439 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:17.606289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad9ec-c1e6-4987-b1dd-d5427691491d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:17.616647 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:17.653800 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036ad0d-c959-4371-94bc-a79917d6eb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:17.654824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273d2a8-e609-432a-a8bc-99dabb84fec9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:17.654947 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036ad0d-c959-4371-94bc-a79917d6eb1c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:17.655367 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036ad0d-c959-4371-94bc-a79917d6eb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:17.655779 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036ad0d-c959-4371-94bc-a79917d6eb1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:17.669741 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036ad0d-c959-4371-94bc-a79917d6eb1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:17.672081 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036ad0d-c959-4371-94bc-a79917d6eb1c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8036ad0d-c959-4371-94bc-a79917d6eb1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:17.695753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:17.696771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:17.697678 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:17.697678 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:17.697678 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:17.697678 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:17.697892 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a0f2d-9d90-4385-ba58-01ac51acde5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:17.697987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0f2d-9d90-4385-ba58-01ac51acde5b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:17.698533 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0f2d-9d90-4385-ba58-01ac51acde5b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:17.698899 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0f2d-9d90-4385-ba58-01ac51acde5b None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:17.699747 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a0f2d-9d90-4385-ba58-01ac51acde5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:17.700219 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a0f2d-9d90-4385-ba58-01ac51acde5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:17.700622 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 333/677] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:17.701636 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036ad0d-c959-4371-94bc-a79917d6eb1c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:17.706178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a0f2d-9d90-4385-ba58-01ac51acde5b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:17.726616 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 345/678] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:17.727611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a0f2d-9d90-4385-ba58-01ac51acde5b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:17.825715 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036ad0d-c959-4371-94bc-a79917d6eb1c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:17.842661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:17.850105 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a0f2d-9d90-4385-ba58-01ac51acde5b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:17.860355 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8924de2-453b-482d-b7e4-a05556dbeb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:17.861130 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8924de2-453b-482d-b7e4-a05556dbeb9c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:17.861486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8924de2-453b-482d-b7e4-a05556dbeb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:17.861835 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8924de2-453b-482d-b7e4-a05556dbeb9c None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:17.862699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8924de2-453b-482d-b7e4-a05556dbeb9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:17.863758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8924de2-453b-482d-b7e4-a05556dbeb9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:17.865201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8924de2-453b-482d-b7e4-a05556dbeb9c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:17.877404 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 334/679] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:17.878341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8924de2-453b-482d-b7e4-a05556dbeb9c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:17.890283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255488fa-3e2b-4859-b538-58618ff8fda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:17.891260 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255488fa-3e2b-4859-b538-58618ff8fda8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:17.891721 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255488fa-3e2b-4859-b538-58618ff8fda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:17.892326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255488fa-3e2b-4859-b538-58618ff8fda8 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:17.893271 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255488fa-3e2b-4859-b538-58618ff8fda8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:17.893772 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255488fa-3e2b-4859-b538-58618ff8fda8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:17.895431 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255488fa-3e2b-4859-b538-58618ff8fda8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:17.905351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:17.908739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 346/680] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:17.909829 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255488fa-3e2b-4859-b538-58618ff8fda8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:17.987466 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8924de2-453b-482d-b7e4-a05556dbeb9c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:18.022771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d7f6f-6508-4204-bb4e-86d90e98cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:18.023427 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d7f6f-6508-4204-bb4e-86d90e98cf9d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:18.023711 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d7f6f-6508-4204-bb4e-86d90e98cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:18.023955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255488fa-3e2b-4859-b538-58618ff8fda8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:18.024082 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d7f6f-6508-4204-bb4e-86d90e98cf9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:18.024828 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d7f6f-6508-4204-bb4e-86d90e98cf9d None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=0712574ba8f54b4283c50a74019d315b) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:18.025174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d7f6f-6508-4204-bb4e-86d90e98cf9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:18.026600 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d7f6f-6508-4204-bb4e-86d90e98cf9d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:18.041097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 335/681] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:17 2022] GET /identity/v3/role_assignments?user.id=0712574ba8f54b4283c50a74019d315b&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:18.042087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d7f6f-6508-4204-bb4e-86d90e98cf9d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:18.068622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640b3d0-251e-44a5-9114-26a779ebca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:18.069735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640b3d0-251e-44a5-9114-26a779ebca2a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:18.070190 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640b3d0-251e-44a5-9114-26a779ebca2a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:18.070614 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640b3d0-251e-44a5-9114-26a779ebca2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:18.071762 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640b3d0-251e-44a5-9114-26a779ebca2a None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=878b64982654402297d65a8ca4ad6ef0) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:18.072230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640b3d0-251e-44a5-9114-26a779ebca2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:18.073964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640b3d0-251e-44a5-9114-26a779ebca2a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:18.081498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 347/682] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:17 2022] GET /identity/v3/role_assignments?user.id=878b64982654402297d65a8ca4ad6ef0&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:18.083330 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2b236-6639-4883-8533-8f45b6e2e61e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:18.083867 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2b236-6639-4883-8533-8f45b6e2e61e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:18.084431 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2b236-6639-4883-8533-8f45b6e2e61e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:18.086463 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 348/683] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:18.103193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d9d52-7152-409c-845b-dcc7dcceb3f2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:18.103838 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d9d52-7152-409c-845b-dcc7dcceb3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:18.104434 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d9d52-7152-409c-845b-dcc7dcceb3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:18.135564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5a0d9d52-7152-409c-845b-dcc7dcceb3f2 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:18.139272 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5a0d9d52-7152-409c-845b-dcc7dcceb3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:18.185370 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:18.218501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:18.249227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d7f6f-6508-4204-bb4e-86d90e98cf9d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:18.271782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 349/684] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:02:18.291575 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d621053-9ed0-4e0e-a2ce-31db90692590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:18.292480 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621053-9ed0-4e0e-a2ce-31db90692590 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:18.292766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621053-9ed0-4e0e-a2ce-31db90692590 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:18.293070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621053-9ed0-4e0e-a2ce-31db90692590 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:18.300872 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d9d52-7152-409c-845b-dcc7dcceb3f2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:18.305407 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d621053-9ed0-4e0e-a2ce-31db90692590 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:18.307110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d621053-9ed0-4e0e-a2ce-31db90692590 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0d621053-9ed0-4e0e-a2ce-31db90692590 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:18.324074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:18.325523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:18.326457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:18.326457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:18.326457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:18.326457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:18.326457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:18.326457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:18.326457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:18.326457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:18.326457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:18.326457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:18.326457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 336/685] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:18.333890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d621053-9ed0-4e0e-a2ce-31db90692590 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:18.426146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d9d52-7152-409c-845b-dcc7dcceb3f2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:18.458242 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d621053-9ed0-4e0e-a2ce-31db90692590 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:18.461874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb384c0-b4f7-4d71-a13f-323955ee4205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:18.462684 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb384c0-b4f7-4d71-a13f-323955ee4205 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:18.462969 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb384c0-b4f7-4d71-a13f-323955ee4205 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:18.463249 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb384c0-b4f7-4d71-a13f-323955ee4205 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:18.475700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb384c0-b4f7-4d71-a13f-323955ee4205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-3cb384c0-b4f7-4d71-a13f-323955ee4205 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:18.483487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:18.484424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:18.485288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 350/686] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:18.490745 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb384c0-b4f7-4d71-a13f-323955ee4205 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:18.508222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d4d27-0e00-4217-9aa7-e96a0b7223a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:18.509353 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d4d27-0e00-4217-9aa7-e96a0b7223a0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:18.509889 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d4d27-0e00-4217-9aa7-e96a0b7223a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:18.510369 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d4d27-0e00-4217-9aa7-e96a0b7223a0 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:18.511412 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d4d27-0e00-4217-9aa7-e96a0b7223a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:18.511967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d4d27-0e00-4217-9aa7-e96a0b7223a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:18.514444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d4d27-0e00-4217-9aa7-e96a0b7223a0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:18.515999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:18.543265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:18.552381 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 337/687] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 10:02:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:18.557763 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d4d27-0e00-4217-9aa7-e96a0b7223a0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:18.684078 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d4d27-0e00-4217-9aa7-e96a0b7223a0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:18.715665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb384c0-b4f7-4d71-a13f-323955ee4205 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:18.722335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a81ad-99ac-4069-84f1-70fdfb4563f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:18.723492 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a81ad-99ac-4069-84f1-70fdfb4563f1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:18.723853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a81ad-99ac-4069-84f1-70fdfb4563f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:18.724129 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a81ad-99ac-4069-84f1-70fdfb4563f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:18.797922 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a81ad-99ac-4069-84f1-70fdfb4563f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:18.799546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a81ad-99ac-4069-84f1-70fdfb4563f1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:18.809321 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:18.820855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd99bb-0570-4458-9aa1-326eb42ae756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:18.821558 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd99bb-0570-4458-9aa1-326eb42ae756 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:18.821850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd99bb-0570-4458-9aa1-326eb42ae756 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:18.822140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd99bb-0570-4458-9aa1-326eb42ae756 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:18.822872 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd99bb-0570-4458-9aa1-326eb42ae756 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:18.823353 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd99bb-0570-4458-9aa1-326eb42ae756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:18.824730 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd99bb-0570-4458-9aa1-326eb42ae756 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:18.850704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 351/688] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:18.855955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd99bb-0570-4458-9aa1-326eb42ae756 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:18.939979 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 338/689] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:18.949925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a81ad-99ac-4069-84f1-70fdfb4563f1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:18.962858 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:18.991193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd99bb-0570-4458-9aa1-326eb42ae756 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:19.031803 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36e1fb-7d4c-4f01-9051-9d34ac9287ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:19.032762 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e1fb-7d4c-4f01-9051-9d34ac9287ab None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.033180 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e1fb-7d4c-4f01-9051-9d34ac9287ab None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.033568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e1fb-7d4c-4f01-9051-9d34ac9287ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.045110 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36e1fb-7d4c-4f01-9051-9d34ac9287ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:19.046698 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36e1fb-7d4c-4f01-9051-9d34ac9287ab None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4d36e1fb-7d4c-4f01-9051-9d34ac9287ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:19.067474 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:19.068539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:19.069649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:19.069649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:19.069649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:19.069649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:19.071207 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 352/690] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:19.072638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c796c6-2d0b-48e8-aeea-ae60c11a976d None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.073089 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c796c6-2d0b-48e8-aeea-ae60c11a976d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.073435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c796c6-2d0b-48e8-aeea-ae60c11a976d None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.075022 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 353/691] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:19.076852 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c796c6-2d0b-48e8-aeea-ae60c11a976d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:19.082899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a81ad-99ac-4069-84f1-70fdfb4563f1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:19.097303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:19.117853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc904c4-75e5-47e6-b0c8-b055f5071ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:19.118714 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc904c4-75e5-47e6-b0c8-b055f5071ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.119001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc904c4-75e5-47e6-b0c8-b055f5071ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.119281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc904c4-75e5-47e6-b0c8-b055f5071ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.130228 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc904c4-75e5-47e6-b0c8-b055f5071ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:19.131691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc904c4-75e5-47e6-b0c8-b055f5071ff6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-edc904c4-75e5-47e6-b0c8-b055f5071ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:19.150055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:19.151073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:19.152252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:19.152252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:19.152252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:19.152252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:19.155847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 339/692] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:19.157478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825a0c2-5e87-464f-b02a-35e272673fd8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.157773 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825a0c2-5e87-464f-b02a-35e272673fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.158056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825a0c2-5e87-464f-b02a-35e272673fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.174424 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-3825a0c2-5e87-464f-b02a-35e272673fd8 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:19.176129 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3825a0c2-5e87-464f-b02a-35e272673fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:19.184516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c796c6-2d0b-48e8-aeea-ae60c11a976d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:19.208350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:19.220811 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b03d7-a79c-4488-a57b-0916999f352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:19.221820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b03d7-a79c-4488-a57b-0916999f352a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.222306 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b03d7-a79c-4488-a57b-0916999f352a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.222782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b03d7-a79c-4488-a57b-0916999f352a None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.223643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b03d7-a79c-4488-a57b-0916999f352a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:19.224132 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b03d7-a79c-4488-a57b-0916999f352a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:19.225743 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b03d7-a79c-4488-a57b-0916999f352a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:19.239321 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 354/693] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:19.240418 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b03d7-a79c-4488-a57b-0916999f352a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:19.245411 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 340/694] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:19.250354 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825a0c2-5e87-464f-b02a-35e272673fd8 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:19.367073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:19.383329 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b03d7-a79c-4488-a57b-0916999f352a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:19.386701 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825a0c2-5e87-464f-b02a-35e272673fd8 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:19.423787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43799e70-dce6-48cb-8fb2-918497cc4c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:19.424463 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43799e70-dce6-48cb-8fb2-918497cc4c5c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.424750 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43799e70-dce6-48cb-8fb2-918497cc4c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.425063 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43799e70-dce6-48cb-8fb2-918497cc4c5c None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.425822 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43799e70-dce6-48cb-8fb2-918497cc4c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:19.426129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43799e70-dce6-48cb-8fb2-918497cc4c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:19.426749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a0a5c-392e-4505-9c73-bc3220a2a804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:19.427487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43799e70-dce6-48cb-8fb2-918497cc4c5c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:19.427999 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a0a5c-392e-4505-9c73-bc3220a2a804 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.428481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a0a5c-392e-4505-9c73-bc3220a2a804 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.428980 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a0a5c-392e-4505-9c73-bc3220a2a804 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.437116 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a0a5c-392e-4505-9c73-bc3220a2a804 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:19.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a0a5c-392e-4505-9c73-bc3220a2a804 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:19.443764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 355/695] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:19.443764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43799e70-dce6-48cb-8fb2-918497cc4c5c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-410a0a5c-392e-4505-9c73-bc3220a2a804 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:19.463496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:19.464569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:19.465538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:19.465538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:19.465538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:19.465538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:19.465538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:19.465538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:19.465538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:19.465538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:19.465538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:19.465538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:19.468526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 341/696] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 10:02:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:19.470027 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a0a5c-392e-4505-9c73-bc3220a2a804 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:19.491292 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:19.547491 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43799e70-dce6-48cb-8fb2-918497cc4c5c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:19.579611 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a0a5c-392e-4505-9c73-bc3220a2a804 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:19.582172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15c0a-6899-4d4b-a80f-ffd30e3a0a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:19.583144 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15c0a-6899-4d4b-a80f-ffd30e3a0a72 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.583268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15c0a-6899-4d4b-a80f-ffd30e3a0a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.583523 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15c0a-6899-4d4b-a80f-ffd30e3a0a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.594309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15c0a-6899-4d4b-a80f-ffd30e3a0a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:19.595897 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15c0a-6899-4d4b-a80f-ffd30e3a0a72 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-7ad15c0a-6899-4d4b-a80f-ffd30e3a0a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:19.613799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:19.614665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:19.615541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:19.615541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:19.615541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:19.615541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:19.620246 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893db3e-822b-4042-8ddd-b5a1159b3fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:19.620409 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 356/697] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:19.621144 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15c0a-6899-4d4b-a80f-ffd30e3a0a72 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:19.621728 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893db3e-822b-4042-8ddd-b5a1159b3fdc None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.622213 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893db3e-822b-4042-8ddd-b5a1159b3fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.622685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893db3e-822b-4042-8ddd-b5a1159b3fdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.630846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893db3e-822b-4042-8ddd-b5a1159b3fdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:19.632740 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893db3e-822b-4042-8ddd-b5a1159b3fdc None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8893db3e-822b-4042-8ddd-b5a1159b3fdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:19.647749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:19.648630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:19.649535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:19.649535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:19.649535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:19.649535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:19.649535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:19.649535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:19.649535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:19.649535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:19.656502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 342/698] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:19.657548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893db3e-822b-4042-8ddd-b5a1159b3fdc None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:19.685207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:19.722038 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:19.730969 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15c0a-6899-4d4b-a80f-ffd30e3a0a72 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:19.765028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893db3e-822b-4042-8ddd-b5a1159b3fdc None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:19.773643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f56e96-c8ac-45c9-bd5d-77a2501b2a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:19.774928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f56e96-c8ac-45c9-bd5d-77a2501b2a58 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.775424 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f56e96-c8ac-45c9-bd5d-77a2501b2a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.776186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f56e96-c8ac-45c9-bd5d-77a2501b2a58 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.777559 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f56e96-c8ac-45c9-bd5d-77a2501b2a58 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:19.778239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f56e96-c8ac-45c9-bd5d-77a2501b2a58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:19.780570 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f56e96-c8ac-45c9-bd5d-77a2501b2a58 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:19.799913 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086e96a-9738-44d7-8250-1aacb302c9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:19.801160 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e96a-9738-44d7-8250-1aacb302c9ff None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.801386 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e96a-9738-44d7-8250-1aacb302c9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.801661 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e96a-9738-44d7-8250-1aacb302c9ff None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.802384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086e96a-9738-44d7-8250-1aacb302c9ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:19.802690 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086e96a-9738-44d7-8250-1aacb302c9ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:19.804119 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086e96a-9738-44d7-8250-1aacb302c9ff None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:19.804904 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 357/699] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 10:02:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:19.806190 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f56e96-c8ac-45c9-bd5d-77a2501b2a58 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:19.820866 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 343/700] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:19.821922 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086e96a-9738-44d7-8250-1aacb302c9ff None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:19.913372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:19.915087 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f56e96-c8ac-45c9-bd5d-77a2501b2a58 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:19.944836 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086e96a-9738-44d7-8250-1aacb302c9ff None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:19.952028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8baf1-e9e5-46e5-ab31-2176678794ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:19.952909 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8baf1-e9e5-46e5-ab31-2176678794ff None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.953043 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8baf1-e9e5-46e5-ab31-2176678794ff None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.953273 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8baf1-e9e5-46e5-ab31-2176678794ff None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.954060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8baf1-e9e5-46e5-ab31-2176678794ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:19.954374 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8baf1-e9e5-46e5-ab31-2176678794ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:19.955870 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8baf1-e9e5-46e5-ab31-2176678794ff None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:19.973015 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 358/701] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:19.973924 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8baf1-e9e5-46e5-ab31-2176678794ff None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:19.982100 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d4aed-1044-43a7-905a-34654b35be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:19.983024 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d4aed-1044-43a7-905a-34654b35be65 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:19.983631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d4aed-1044-43a7-905a-34654b35be65 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:19.984115 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d4aed-1044-43a7-905a-34654b35be65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:19.991267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:20.059705 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d4aed-1044-43a7-905a-34654b35be65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:20.061599 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d4aed-1044-43a7-905a-34654b35be65 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:20.078726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8baf1-e9e5-46e5-ab31-2176678794ff None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:20.114560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba267e-f44a-4d30-a4aa-885871f93f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:20.115239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba267e-f44a-4d30-a4aa-885871f93f35 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:20.115524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba267e-f44a-4d30-a4aa-885871f93f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:20.115805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba267e-f44a-4d30-a4aa-885871f93f35 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:20.116507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba267e-f44a-4d30-a4aa-885871f93f35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:20.117988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba267e-f44a-4d30-a4aa-885871f93f35 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:20.129585 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:20.141284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 359/702] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:02:19 2022] POST /identity/v3/users => generated 254 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:20.142406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba267e-f44a-4d30-a4aa-885871f93f35 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:20.174091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 344/703] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:20.179102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d4aed-1044-43a7-905a-34654b35be65 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:20.301805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:20.361661 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d4aed-1044-43a7-905a-34654b35be65 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:20.364843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba267e-f44a-4d30-a4aa-885871f93f35 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:20.402508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cd29c-8f4b-4689-b56b-46f020d8278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:20.403321 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cd29c-8f4b-4689-b56b-46f020d8278e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:20.403606 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cd29c-8f4b-4689-b56b-46f020d8278e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:20.403885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cd29c-8f4b-4689-b56b-46f020d8278e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:20.414056 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fe283-978b-40ad-a232-f7bd42fd7d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:20.414732 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fe283-978b-40ad-a232-f7bd42fd7d6e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:20.415025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fe283-978b-40ad-a232-f7bd42fd7d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:20.415306 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fe283-978b-40ad-a232-f7bd42fd7d6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:20.416147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fe283-978b-40ad-a232-f7bd42fd7d6e None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=1167f58a1ea3465083d67a94043066be) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:20.416462 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fe283-978b-40ad-a232-f7bd42fd7d6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:20.417933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fe283-978b-40ad-a232-f7bd42fd7d6e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:20.421685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cd29c-8f4b-4689-b56b-46f020d8278e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:20.423278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cd29c-8f4b-4689-b56b-46f020d8278e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:20.425378 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 360/704] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:20 2022] GET /identity/v3/role_assignments?user.id=1167f58a1ea3465083d67a94043066be&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:20.427233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e73d9-7d0e-4e37-bebe-e8ee88525ed6 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:20.427527 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e73d9-7d0e-4e37-bebe-e8ee88525ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:20.427817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e73d9-7d0e-4e37-bebe-e8ee88525ed6 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:20.431946 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 361/705] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:20.434361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c400d-9e96-48cb-bd15-54ec9cf8f0e7 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:20.435143 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c400d-9e96-48cb-bd15-54ec9cf8f0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:20.435581 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c400d-9e96-48cb-bd15-54ec9cf8f0e7 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:20.437946 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 362/706] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:20.439682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413593de-5010-4553-bc3b-d7ae040da206 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:20.440114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413593de-5010-4553-bc3b-d7ae040da206 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:20.440533 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413593de-5010-4553-bc3b-d7ae040da206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-6a7cd29c-8f4b-4689-b56b-46f020d8278e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:20.443185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:20.444695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:20.446229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:20.446229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:20.446229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:20.446229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:20.446229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 345/707] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:20.446229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a70c87-3be9-4dc1-ac8d-3d33c3aefcf1 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:20.446786 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a70c87-3be9-4dc1-ac8d-3d33c3aefcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:20.446786 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a70c87-3be9-4dc1-ac8d-3d33c3aefcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:20.468276 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-413593de-5010-4553-bc3b-d7ae040da206 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:20.469919 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-413593de-5010-4553-bc3b-d7ae040da206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:20.471043 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c8a70c87-3be9-4dc1-ac8d-3d33c3aefcf1 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:20.472739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c8a70c87-3be9-4dc1-ac8d-3d33c3aefcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:20.486206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:20.562725 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 346/708] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:20.564050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a70c87-3be9-4dc1-ac8d-3d33c3aefcf1 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:20.578671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 363/709] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:20.602769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413593de-5010-4553-bc3b-d7ae040da206 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:20.672791 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:20.685528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a70c87-3be9-4dc1-ac8d-3d33c3aefcf1 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:20.719061 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413593de-5010-4553-bc3b-d7ae040da206 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:20.730711 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258a5f8-cf02-4a14-9363-30671baff7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:20.731705 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a5f8-cf02-4a14-9363-30671baff7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:20.731999 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a5f8-cf02-4a14-9363-30671baff7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:20.732285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a5f8-cf02-4a14-9363-30671baff7d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:20.733361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258a5f8-cf02-4a14-9363-30671baff7d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:20.733675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258a5f8-cf02-4a14-9363-30671baff7d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:20.735566 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258a5f8-cf02-4a14-9363-30671baff7d7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:20.747910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 347/710] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:20.748752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258a5f8-cf02-4a14-9363-30671baff7d7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:20.753530 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:20.759029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a38e-a29d-41b0-988e-21c41a2baab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:20.759858 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a38e-a29d-41b0-988e-21c41a2baab5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:20.760142 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a38e-a29d-41b0-988e-21c41a2baab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:20.760979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a38e-a29d-41b0-988e-21c41a2baab5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:20.761651 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40a38e-a29d-41b0-988e-21c41a2baab5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:20.763217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40a38e-a29d-41b0-988e-21c41a2baab5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-2f40a38e-a29d-41b0-988e-21c41a2baab5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:20.777827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:20.778828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 10:02:20.779645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:20.781147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 364/711] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Jul 5 10:02:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:20.781382 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a38e-a29d-41b0-988e-21c41a2baab5 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:20.883910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258a5f8-cf02-4a14-9363-30671baff7d7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:20.904007 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a38e-a29d-41b0-988e-21c41a2baab5 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:20.926867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa93b2-e70c-42f4-be75-c2f36062525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:20.927678 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa93b2-e70c-42f4-be75-c2f36062525b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:20.927961 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa93b2-e70c-42f4-be75-c2f36062525b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:20.928238 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa93b2-e70c-42f4-be75-c2f36062525b None admin] PATH_INFO: `/v3/services/network` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:20.928993 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa93b2-e70c-42f4-be75-c2f36062525b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:20.930907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa93b2-e70c-42f4-be75-c2f36062525b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:20.938149 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:20.947701 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd956-b375-4bf2-b29d-8a52e81751b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e0fa93b2-e70c-42f4-be75-c2f36062525b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:20.947853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:20.948825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:20.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 348/712] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:20 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:20.955246 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa93b2-e70c-42f4-be75-c2f36062525b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:20.955325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd956-b375-4bf2-b29d-8a52e81751b3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:20.955325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd956-b375-4bf2-b29d-8a52e81751b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:20.955325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd956-b375-4bf2-b29d-8a52e81751b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:20.963587 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fd956-b375-4bf2-b29d-8a52e81751b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:20.965101 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fd956-b375-4bf2-b29d-8a52e81751b3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-487fd956-b375-4bf2-b29d-8a52e81751b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:20.981241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:20.982172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:20.983492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:20.983492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:20.983492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:20.983492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:20.983492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:20.983492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:20.983492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:20.983492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:20.983492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 365/713] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:20.983492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd956-b375-4bf2-b29d-8a52e81751b3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:21.034941 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:21.072790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa93b2-e70c-42f4-be75-c2f36062525b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:21.100597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd956-b375-4bf2-b29d-8a52e81751b3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:21.119797 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d048438-784a-4857-8bf5-f9fed47bdfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:21.121453 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d048438-784a-4857-8bf5-f9fed47bdfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:21.121967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d048438-784a-4857-8bf5-f9fed47bdfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:21.122449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d048438-784a-4857-8bf5-f9fed47bdfa6 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:21.123355 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d048438-784a-4857-8bf5-f9fed47bdfa6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:21.124401 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d048438-784a-4857-8bf5-f9fed47bdfa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:21.126583 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d048438-784a-4857-8bf5-f9fed47bdfa6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:21.135917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 349/714] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 10:02:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:21.137395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d048438-784a-4857-8bf5-f9fed47bdfa6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:21.138823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaa042-b74d-42af-975a-3916b9db8457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:21.139494 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa042-b74d-42af-975a-3916b9db8457 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:21.139794 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa042-b74d-42af-975a-3916b9db8457 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:21.140341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa042-b74d-42af-975a-3916b9db8457 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:21.141079 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaa042-b74d-42af-975a-3916b9db8457 None admin] RBAC: Adding query filter params (name=network) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:21.141403 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaa042-b74d-42af-975a-3916b9db8457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:21.143488 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaa042-b74d-42af-975a-3916b9db8457 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:21.153485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 366/715] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:21.155091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaa042-b74d-42af-975a-3916b9db8457 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:21.226733 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:21.254227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d048438-784a-4857-8bf5-f9fed47bdfa6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:21.288055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:21.298730 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaa042-b74d-42af-975a-3916b9db8457 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:21.303810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061baa4-be42-4d8f-bd45-12d20786ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:21.304746 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061baa4-be42-4d8f-bd45-12d20786ec74 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:21.305273 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061baa4-be42-4d8f-bd45-12d20786ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:21.305774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061baa4-be42-4d8f-bd45-12d20786ec74 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:21.306804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061baa4-be42-4d8f-bd45-12d20786ec74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:21.307869 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061baa4-be42-4d8f-bd45-12d20786ec74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:21.310043 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061baa4-be42-4d8f-bd45-12d20786ec74 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:21.329141 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 350/716] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:21.330364 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061baa4-be42-4d8f-bd45-12d20786ec74 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:21.340311 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9e82c-6b52-4404-8813-ce20fe326257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:21.341030 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9e82c-6b52-4404-8813-ce20fe326257 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:21.341316 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9e82c-6b52-4404-8813-ce20fe326257 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:21.341651 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9e82c-6b52-4404-8813-ce20fe326257 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:21.342404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9e82c-6b52-4404-8813-ce20fe326257 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:21.342712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9e82c-6b52-4404-8813-ce20fe326257 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:21.344098 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9e82c-6b52-4404-8813-ce20fe326257 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:21.351397 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 367/717] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 10:02:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:21.352264 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9e82c-6b52-4404-8813-ce20fe326257 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:21.481981 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9e82c-6b52-4404-8813-ce20fe326257 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:21.501843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:21.523746 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba263a-ef72-4e80-98c5-60f8a36c5029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:21.524814 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba263a-ef72-4e80-98c5-60f8a36c5029 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:21.525330 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba263a-ef72-4e80-98c5-60f8a36c5029 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:21.525839 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba263a-ef72-4e80-98c5-60f8a36c5029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:21.527233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba263a-ef72-4e80-98c5-60f8a36c5029 None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=1ff81129f179478d901b590a5be64f38) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:21.528032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba263a-ef72-4e80-98c5-60f8a36c5029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:21.529774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba263a-ef72-4e80-98c5-60f8a36c5029 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:21.537872 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 368/718] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:21 2022] GET /identity/v3/role_assignments?user.id=1ff81129f179478d901b590a5be64f38&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:21.548025 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061baa4-be42-4d8f-bd45-12d20786ec74 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:21.592487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa199fe8-c6bf-4019-85da-1c3ae2cf8f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:21.593734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199fe8-c6bf-4019-85da-1c3ae2cf8f59 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:21.594239 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199fe8-c6bf-4019-85da-1c3ae2cf8f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:21.594744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199fe8-c6bf-4019-85da-1c3ae2cf8f59 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:21.596164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199fe8-c6bf-4019-85da-1c3ae2cf8f59 None admin] RBAC: Adding query filter params (type=network) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:21.596738 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199fe8-c6bf-4019-85da-1c3ae2cf8f59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:21.599843 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199fe8-c6bf-4019-85da-1c3ae2cf8f59 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:21.607300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 351/719] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:22.619100 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f9dc7-7d48-421e-9c59-ed08b4a24478 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:22.619638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f9dc7-7d48-421e-9c59-ed08b4a24478 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:22.619638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f9dc7-7d48-421e-9c59-ed08b4a24478 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:22.621368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 369/720] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:22.626838 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf490a-ae47-4652-927e-df504e3fc962 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:22.627263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf490a-ae47-4652-927e-df504e3fc962 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:22.627481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf490a-ae47-4652-927e-df504e3fc962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:22.650184 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5dcf490a-ae47-4652-927e-df504e3fc962 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:22.651455 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5dcf490a-ae47-4652-927e-df504e3fc962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:22.713067 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:22.739736 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 352/721] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:22.786499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f9dc7-7d48-421e-9c59-ed08b4a24478 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:22.915573 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f9dc7-7d48-421e-9c59-ed08b4a24478 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:22.957055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0df0d-a072-45bd-a343-4620a2b80dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:22.957866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0df0d-a072-45bd-a343-4620a2b80dad None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:22.958158 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0df0d-a072-45bd-a343-4620a2b80dad None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:22.958441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0df0d-a072-45bd-a343-4620a2b80dad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:22.973191 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0df0d-a072-45bd-a343-4620a2b80dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-78f0df0d-a072-45bd-a343-4620a2b80dad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:22.980973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:22.981901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:22.982740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:22.987044 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 370/722] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:22.988994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf490a-ae47-4652-927e-df504e3fc962 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:23.000423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba444c-2a83-4bc3-82ae-577922768630 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:23.000727 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba444c-2a83-4bc3-82ae-577922768630 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:23.001041 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba444c-2a83-4bc3-82ae-577922768630 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:23.002529 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 371/723] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:23.008021 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29368-26e9-49e8-b5fc-ec750d713446 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:23.008317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29368-26e9-49e8-b5fc-ec750d713446 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:23.008602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29368-26e9-49e8-b5fc-ec750d713446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:23.031101 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-61d29368-26e9-49e8-b5fc-ec750d713446 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:23.032663 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-61d29368-26e9-49e8-b5fc-ec750d713446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:23.085248 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:23.137427 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 372/724] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 10:02:23.164660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d29368-26e9-49e8-b5fc-ec750d713446 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:23.209616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf490a-ae47-4652-927e-df504e3fc962 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:23.289609 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8071159-d43c-47ae-b156-70f4be305202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:23.290311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8071159-d43c-47ae-b156-70f4be305202 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:23.290602 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8071159-d43c-47ae-b156-70f4be305202 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:23.290889 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8071159-d43c-47ae-b156-70f4be305202 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:23.291659 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8071159-d43c-47ae-b156-70f4be305202 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:23.291977 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8071159-d43c-47ae-b156-70f4be305202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:23.293398 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8071159-d43c-47ae-b156-70f4be305202 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:23.320105 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d29368-26e9-49e8-b5fc-ec750d713446 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:23.320688 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 353/725] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:23.330181 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8071159-d43c-47ae-b156-70f4be305202 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:23.364309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faf3ab-38b1-4344-b115-f9698c9b09df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:23.366163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faf3ab-38b1-4344-b115-f9698c9b09df None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:23.366453 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faf3ab-38b1-4344-b115-f9698c9b09df None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:23.366735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faf3ab-38b1-4344-b115-f9698c9b09df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:23.392028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1faf3ab-38b1-4344-b115-f9698c9b09df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-a1faf3ab-38b1-4344-b115-f9698c9b09df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:23.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:23.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:23.410220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 373/726] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:23.417784 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faf3ab-38b1-4344-b115-f9698c9b09df None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:23.430180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:23.481673 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:23.482886 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8071159-d43c-47ae-b156-70f4be305202 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:23.544923 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b04d0-e221-4018-9a15-3695170775b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:23.545390 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b04d0-e221-4018-9a15-3695170775b7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:23.546952 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b04d0-e221-4018-9a15-3695170775b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:23.546952 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b04d0-e221-4018-9a15-3695170775b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:23.565349 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b04d0-e221-4018-9a15-3695170775b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:23.568927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b04d0-e221-4018-9a15-3695170775b7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-429b04d0-e221-4018-9a15-3695170775b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:23.586749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:23.587654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:23.588523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:23.588523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:23.588523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:23.588523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:23.588523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 354/727] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:23.593624 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b04d0-e221-4018-9a15-3695170775b7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:23.714891 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faf3ab-38b1-4344-b115-f9698c9b09df None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:23.742695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:23.745727 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b04d0-e221-4018-9a15-3695170775b7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:23.782834 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b8141-9f6a-4b9c-9be7-d36d314b01c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:23.784147 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b8141-9f6a-4b9c-9be7-d36d314b01c4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:23.784434 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b8141-9f6a-4b9c-9be7-d36d314b01c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:23.785425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b8141-9f6a-4b9c-9be7-d36d314b01c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:23.786166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b8141-9f6a-4b9c-9be7-d36d314b01c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:23.786475 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b8141-9f6a-4b9c-9be7-d36d314b01c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:23.787865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b8141-9f6a-4b9c-9be7-d36d314b01c4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:23.803216 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 355/728] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:23.808343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b8141-9f6a-4b9c-9be7-d36d314b01c4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:23.834239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62d422-fcd7-4028-8d05-1d4bc1727120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:23.834941 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d422-fcd7-4028-8d05-1d4bc1727120 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:23.835224 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d422-fcd7-4028-8d05-1d4bc1727120 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:23.835503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d422-fcd7-4028-8d05-1d4bc1727120 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:23.836259 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62d422-fcd7-4028-8d05-1d4bc1727120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:23.836566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62d422-fcd7-4028-8d05-1d4bc1727120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:23.846224 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62d422-fcd7-4028-8d05-1d4bc1727120 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:23.875211 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 374/729] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:23.880339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62d422-fcd7-4028-8d05-1d4bc1727120 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:23.970267 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b8141-9f6a-4b9c-9be7-d36d314b01c4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:24.027013 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7c70a-3f1f-41ff-89ab-6afddc0d6f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:24.032915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7c70a-3f1f-41ff-89ab-6afddc0d6f7a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.032915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7c70a-3f1f-41ff-89ab-6afddc0d6f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.032915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7c70a-3f1f-41ff-89ab-6afddc0d6f7a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.055438 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7c70a-3f1f-41ff-89ab-6afddc0d6f7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:24.057581 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7c70a-3f1f-41ff-89ab-6afddc0d6f7a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:24.079674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-37b7c70a-3f1f-41ff-89ab-6afddc0d6f7a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:24.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:24.090975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:24.091911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:24.091911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:24.091911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:24.091911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:24.091911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:24.091911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:24.091911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:24.091911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:24.091911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:24.091911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:24.098475 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 356/730] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 10:02:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:24.102953 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62d422-fcd7-4028-8d05-1d4bc1727120 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:24.104012 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a392be-e9bc-4d80-b38e-2f327eaf9dc1 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.104322 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a392be-e9bc-4d80-b38e-2f327eaf9dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.104600 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a392be-e9bc-4d80-b38e-2f327eaf9dc1 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.106895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 357/731] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:24.107136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a392be-e9bc-4d80-b38e-2f327eaf9dc1 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:24.130082 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:24.144722 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88932026-7504-4711-b89a-ff2652b6be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:24.145934 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88932026-7504-4711-b89a-ff2652b6be4a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.146459 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88932026-7504-4711-b89a-ff2652b6be4a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.146936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88932026-7504-4711-b89a-ff2652b6be4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.158597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88932026-7504-4711-b89a-ff2652b6be4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:24.160384 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88932026-7504-4711-b89a-ff2652b6be4a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-88932026-7504-4711-b89a-ff2652b6be4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:24.181359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:24.182342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:24.183227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:24.183227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:24.183227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:24.183227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:24.183227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 375/732] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:24.184667 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbda6f-8aec-4321-aa49-629cb225706b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.184979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbda6f-8aec-4321-aa49-629cb225706b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.185259 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbda6f-8aec-4321-aa49-629cb225706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.201926 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-96cbda6f-8aec-4321-aa49-629cb225706b None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:24.203109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-96cbda6f-8aec-4321-aa49-629cb225706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:24.213343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a392be-e9bc-4d80-b38e-2f327eaf9dc1 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:24.246881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcd12c-4a08-464d-8aec-337fbc7891e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:24.247548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcd12c-4a08-464d-8aec-337fbc7891e4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.247835 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcd12c-4a08-464d-8aec-337fbc7891e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.248115 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcd12c-4a08-464d-8aec-337fbc7891e4 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.248971 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcd12c-4a08-464d-8aec-337fbc7891e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:24.249342 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcd12c-4a08-464d-8aec-337fbc7891e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:24.250778 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcd12c-4a08-464d-8aec-337fbc7891e4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:24.267641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 358/733] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 10:02:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:24.274922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 376/734] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:24.275075 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f786e0-2de4-4ed9-af66-3d02dd771419 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.275075 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f786e0-2de4-4ed9-af66-3d02dd771419 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.275075 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f786e0-2de4-4ed9-af66-3d02dd771419 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.276626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01884-6ce4-415a-b3a2-d0b08d381ff5 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.276626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01884-6ce4-415a-b3a2-d0b08d381ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.276626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01884-6ce4-415a-b3a2-d0b08d381ff5 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.276626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 377/735] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:24.276626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab01884-6ce4-415a-b3a2-d0b08d381ff5 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:24.277106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 359/736] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:24.277106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2148b8c-1f75-4ea5-83be-36f26c10555e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.277106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2148b8c-1f75-4ea5-83be-36f26c10555e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.277106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2148b8c-1f75-4ea5-83be-36f26c10555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.293414 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d2148b8c-1f75-4ea5-83be-36f26c10555e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:24.294878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d2148b8c-1f75-4ea5-83be-36f26c10555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:24.360487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 360/737] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:24.361849 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f6c77-9e05-4f5c-ad3b-f72d033854cf None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.362153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f6c77-9e05-4f5c-ad3b-f72d033854cf None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.362440 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f6c77-9e05-4f5c-ad3b-f72d033854cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.365960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:24.379251 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-421f6c77-9e05-4f5c-ad3b-f72d033854cf None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:24.380504 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-421f6c77-9e05-4f5c-ad3b-f72d033854cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:24.383048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:24.393604 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab01884-6ce4-415a-b3a2-d0b08d381ff5 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:24.427941 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ea4cb-f452-418d-bf02-c1ff2b849d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:24.428606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ea4cb-f452-418d-bf02-c1ff2b849d0b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.428917 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ea4cb-f452-418d-bf02-c1ff2b849d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.429206 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ea4cb-f452-418d-bf02-c1ff2b849d0b None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.429921 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ea4cb-f452-418d-bf02-c1ff2b849d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:24.430233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ea4cb-f452-418d-bf02-c1ff2b849d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:24.431594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ea4cb-f452-418d-bf02-c1ff2b849d0b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:24.443313 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 378/738] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:24.444122 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ea4cb-f452-418d-bf02-c1ff2b849d0b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:24.448695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 361/739] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 10:02:24.449776 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f6c77-9e05-4f5c-ad3b-f72d033854cf None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:24.546522 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ea4cb-f452-418d-bf02-c1ff2b849d0b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:24.551265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f6c77-9e05-4f5c-ad3b-f72d033854cf None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:24.578755 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47efd8-0f67-4334-8634-2f2b85f0010e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:24.579404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47efd8-0f67-4334-8634-2f2b85f0010e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.579691 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47efd8-0f67-4334-8634-2f2b85f0010e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.579969 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47efd8-0f67-4334-8634-2f2b85f0010e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.583115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:24.585197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d513886-d774-418c-81dc-f1bfacc5ec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:24.585858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513886-d774-418c-81dc-f1bfacc5ec9a None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.586142 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513886-d774-418c-81dc-f1bfacc5ec9a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.586422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513886-d774-418c-81dc-f1bfacc5ec9a None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.587136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d513886-d774-418c-81dc-f1bfacc5ec9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:24.588502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d513886-d774-418c-81dc-f1bfacc5ec9a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:24.598535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:24.605061 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 362/740] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:02:24 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:24.606365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d513886-d774-418c-81dc-f1bfacc5ec9a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:24.670126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47efd8-0f67-4334-8634-2f2b85f0010e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:24.671645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47efd8-0f67-4334-8634-2f2b85f0010e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:24.722466 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d513886-d774-418c-81dc-f1bfacc5ec9a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:24.762146 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d3ccd-4f88-40c2-a8ef-f2805b923824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:24.762829 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3ccd-4f88-40c2-a8ef-f2805b923824 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.764232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3ccd-4f88-40c2-a8ef-f2805b923824 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.764232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3ccd-4f88-40c2-a8ef-f2805b923824 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.764232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d3ccd-4f88-40c2-a8ef-f2805b923824 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:24.765484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d3ccd-4f88-40c2-a8ef-f2805b923824 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:24.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 363/741] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:02:24 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:24.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d3ccd-4f88-40c2-a8ef-f2805b923824 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:24.793873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 379/742] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 10:02:24.795716 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47efd8-0f67-4334-8634-2f2b85f0010e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:24.859676 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:24.873293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:24.917688 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d3ccd-4f88-40c2-a8ef-f2805b923824 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:24.923297 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47efd8-0f67-4334-8634-2f2b85f0010e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:24.956018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014eedc4-76fb-49b0-b40e-e6556955cf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:24.956678 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014eedc4-76fb-49b0-b40e-e6556955cf62 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.957300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014eedc4-76fb-49b0-b40e-e6556955cf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.957300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014eedc4-76fb-49b0-b40e-e6556955cf62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.963793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eaef2-46d3-4d55-bc1a-1bee57029357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:24.964602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eaef2-46d3-4d55-bc1a-1bee57029357 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:24.964883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eaef2-46d3-4d55-bc1a-1bee57029357 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:24.965186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eaef2-46d3-4d55-bc1a-1bee57029357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:24.970117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014eedc4-76fb-49b0-b40e-e6556955cf62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:24.971571 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014eedc4-76fb-49b0-b40e-e6556955cf62 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:24.982183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0eaef2-46d3-4d55-bc1a-1bee57029357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-014eedc4-76fb-49b0-b40e-e6556955cf62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:24.988755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:24.989721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:24.990665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:24.990665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:24.990665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:24.990665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:24.990665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:24.990665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:24.990665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:24.990665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:24.990665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:24.990665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:24.990665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 364/743] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-8a0eaef2-46d3-4d55-bc1a-1bee57029357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:24.991270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:24.992125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:24.997749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:24.999038 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014eedc4-76fb-49b0-b40e-e6556955cf62 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:25.000063 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 380/744] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:25.000063 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eaef2-46d3-4d55-bc1a-1bee57029357 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:25.118756 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014eedc4-76fb-49b0-b40e-e6556955cf62 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:25.124797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:25.130545 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:25.137812 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eaef2-46d3-4d55-bc1a-1bee57029357 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:25.157526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d30b6-0cec-4813-a055-50639d615e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:25.158307 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d30b6-0cec-4813-a055-50639d615e7f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:25.158592 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d30b6-0cec-4813-a055-50639d615e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:25.158866 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d30b6-0cec-4813-a055-50639d615e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:25.171427 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d30b6-0cec-4813-a055-50639d615e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:25.172904 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d30b6-0cec-4813-a055-50639d615e7f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:25.185131 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1f2c4-e55d-4dfb-9e73-6c6e36315b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:25.186164 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f2c4-e55d-4dfb-9e73-6c6e36315b1e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:25.186634 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f2c4-e55d-4dfb-9e73-6c6e36315b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:25.187124 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1f2c4-e55d-4dfb-9e73-6c6e36315b1e None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:25.188149 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1f2c4-e55d-4dfb-9e73-6c6e36315b1e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:25.188646 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1f2c4-e55d-4dfb-9e73-6c6e36315b1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:25.190308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1f2c4-e55d-4dfb-9e73-6c6e36315b1e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-913d30b6-0cec-4813-a055-50639d615e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:25.191734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:25.192630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:25.193569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:25.193569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:25.193569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:25.193569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:25.197611 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 365/745] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:25.198574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d30b6-0cec-4813-a055-50639d615e7f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:25.217491 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 381/746] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 10:02:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:25.218181 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1f2c4-e55d-4dfb-9e73-6c6e36315b1e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:25.321316 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d30b6-0cec-4813-a055-50639d615e7f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:25.336267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1f2c4-e55d-4dfb-9e73-6c6e36315b1e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:25.358579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f55f0-c150-45e7-99af-a7373e255dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:25.359234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f55f0-c150-45e7-99af-a7373e255dae None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:25.359522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f55f0-c150-45e7-99af-a7373e255dae None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:25.359800 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f55f0-c150-45e7-99af-a7373e255dae None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:25.360553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f55f0-c150-45e7-99af-a7373e255dae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:25.360844 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f55f0-c150-45e7-99af-a7373e255dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:25.362304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f55f0-c150-45e7-99af-a7373e255dae None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:25.374701 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ab3d6-514d-4e8b-b329-7a5273fb363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:25.375702 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ab3d6-514d-4e8b-b329-7a5273fb363e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:25.376213 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ab3d6-514d-4e8b-b329-7a5273fb363e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:25.376321 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 366/747] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:25.376811 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ab3d6-514d-4e8b-b329-7a5273fb363e None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:25.377154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f55f0-c150-45e7-99af-a7373e255dae None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:25.378088 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ab3d6-514d-4e8b-b329-7a5273fb363e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:25.378648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ab3d6-514d-4e8b-b329-7a5273fb363e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:25.380231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ab3d6-514d-4e8b-b329-7a5273fb363e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:25.393159 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 382/748] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:25.394802 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ab3d6-514d-4e8b-b329-7a5273fb363e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:25.410289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:25.411711 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:25.493604 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f55f0-c150-45e7-99af-a7373e255dae None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:25.512368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ab3d6-514d-4e8b-b329-7a5273fb363e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:25.531744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc440a7-300d-4552-a101-e11a7c84dd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:25.532710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc440a7-300d-4552-a101-e11a7c84dd29 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:25.533188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc440a7-300d-4552-a101-e11a7c84dd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:25.533618 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc440a7-300d-4552-a101-e11a7c84dd29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:25.562382 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c93e0c-28ce-407c-9bc0-27190d4b6353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:25.563582 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c93e0c-28ce-407c-9bc0-27190d4b6353 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:25.564067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c93e0c-28ce-407c-9bc0-27190d4b6353 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:25.564540 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c93e0c-28ce-407c-9bc0-27190d4b6353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:25.576161 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c93e0c-28ce-407c-9bc0-27190d4b6353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:25.577885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c93e0c-28ce-407c-9bc0-27190d4b6353 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-60c93e0c-28ce-407c-9bc0-27190d4b6353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:25.596419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:25.597367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:25.598241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:25.598241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:25.598241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:25.598241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:25.600451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 383/749] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:25.601482 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c93e0c-28ce-407c-9bc0-27190d4b6353 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:25.611652 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc440a7-300d-4552-a101-e11a7c84dd29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:25.613267 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc440a7-300d-4552-a101-e11a7c84dd29 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:25.639501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:25.665647 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:25.705852 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c93e0c-28ce-407c-9bc0-27190d4b6353 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:25.723765 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 367/750] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:02:25.724661 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc440a7-300d-4552-a101-e11a7c84dd29 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:25.740828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff82c-4256-49c8-8d12-ee3a926370cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:25.741962 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff82c-4256-49c8-8d12-ee3a926370cb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:25.742443 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff82c-4256-49c8-8d12-ee3a926370cb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:25.742913 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff82c-4256-49c8-8d12-ee3a926370cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:25.750182 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aff82c-4256-49c8-8d12-ee3a926370cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:25.751850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aff82c-4256-49c8-8d12-ee3a926370cb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e1aff82c-4256-49c8-8d12-ee3a926370cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:25.766758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:25.767648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:25.768517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:25.768517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:25.768517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:25.768517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:25.768517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:25.768517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:25.768517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:25.768517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:25.771602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 384/751] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:25.772576 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff82c-4256-49c8-8d12-ee3a926370cb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:25.836583 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc440a7-300d-4552-a101-e11a7c84dd29 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:25.868208 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:25.881256 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eea6b0-4dd8-4dd0-8217-3e4117ad4d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:25.881937 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eea6b0-4dd8-4dd0-8217-3e4117ad4d22 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:25.882201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eea6b0-4dd8-4dd0-8217-3e4117ad4d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:25.882474 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eea6b0-4dd8-4dd0-8217-3e4117ad4d22 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:25.883311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eea6b0-4dd8-4dd0-8217-3e4117ad4d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:25.883630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eea6b0-4dd8-4dd0-8217-3e4117ad4d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:25.885149 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eea6b0-4dd8-4dd0-8217-3e4117ad4d22 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:25.898393 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff82c-4256-49c8-8d12-ee3a926370cb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:25.901944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 368/752] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:25.902820 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eea6b0-4dd8-4dd0-8217-3e4117ad4d22 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:25.935376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:25.946452 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ae116-f4cc-429b-a246-38b7886c9a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:25.947633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ae116-f4cc-429b-a246-38b7886c9a29 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:25.948188 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ae116-f4cc-429b-a246-38b7886c9a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:25.948666 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ae116-f4cc-429b-a246-38b7886c9a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:25.960861 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ae116-f4cc-429b-a246-38b7886c9a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:25.962730 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ae116-f4cc-429b-a246-38b7886c9a29 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-437ae116-f4cc-429b-a246-38b7886c9a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:25.982549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:25.983471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:25.984333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:25.984333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:25.984333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:25.984333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:25.986556 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 385/753] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:25.987599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ae116-f4cc-429b-a246-38b7886c9a29 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:26.011006 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eea6b0-4dd8-4dd0-8217-3e4117ad4d22 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:26.048285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe297c6-2823-4266-9f33-22b0c8f4b022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:26.048967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe297c6-2823-4266-9f33-22b0c8f4b022 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.049254 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe297c6-2823-4266-9f33-22b0c8f4b022 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.049529 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe297c6-2823-4266-9f33-22b0c8f4b022 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.050468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe297c6-2823-4266-9f33-22b0c8f4b022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:26.050645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe297c6-2823-4266-9f33-22b0c8f4b022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:26.052067 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe297c6-2823-4266-9f33-22b0c8f4b022 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:26.069071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 369/754] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:26.069824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe297c6-2823-4266-9f33-22b0c8f4b022 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:26.093885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ae116-f4cc-429b-a246-38b7886c9a29 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:26.116004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:26.131907 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eea211-f4b5-4d7c-b9f2-c752b7a3f37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:26.133028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eea211-f4b5-4d7c-b9f2-c752b7a3f37b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.133517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eea211-f4b5-4d7c-b9f2-c752b7a3f37b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.133988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eea211-f4b5-4d7c-b9f2-c752b7a3f37b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.141433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eea211-f4b5-4d7c-b9f2-c752b7a3f37b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:26.143138 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eea211-f4b5-4d7c-b9f2-c752b7a3f37b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-41eea211-f4b5-4d7c-b9f2-c752b7a3f37b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:26.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:26.158649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:26.159608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:26.159608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:26.159608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:26.159608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:26.159608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:26.159608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:26.159608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:26.159608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:26.159608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:26.159608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:26.162054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 386/755] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 10:02:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:26.163061 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eea211-f4b5-4d7c-b9f2-c752b7a3f37b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:26.177044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe297c6-2823-4266-9f33-22b0c8f4b022 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:26.216258 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f81bd5-99ef-40ff-b710-692d7ae8c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:26.216923 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f81bd5-99ef-40ff-b710-692d7ae8c923 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.217221 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f81bd5-99ef-40ff-b710-692d7ae8c923 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.217494 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f81bd5-99ef-40ff-b710-692d7ae8c923 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.218208 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f81bd5-99ef-40ff-b710-692d7ae8c923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:26.218515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f81bd5-99ef-40ff-b710-692d7ae8c923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:26.219870 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f81bd5-99ef-40ff-b710-692d7ae8c923 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:26.229256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:26.231956 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 370/756] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:26.232856 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f81bd5-99ef-40ff-b710-692d7ae8c923 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:26.281437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eea211-f4b5-4d7c-b9f2-c752b7a3f37b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:26.332712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce8c20-c694-488e-8bf4-64aa019ca13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:26.333806 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce8c20-c694-488e-8bf4-64aa019ca13f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.334397 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce8c20-c694-488e-8bf4-64aa019ca13f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.334871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce8c20-c694-488e-8bf4-64aa019ca13f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.336490 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce8c20-c694-488e-8bf4-64aa019ca13f None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=f2683e79ea804a7987642df32f03fad5) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:26.337009 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce8c20-c694-488e-8bf4-64aa019ca13f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:26.339068 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce8c20-c694-488e-8bf4-64aa019ca13f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:26.346761 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 387/757] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:26 2022] GET /identity/v3/role_assignments?user.id=f2683e79ea804a7987642df32f03fad5&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:26.348308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce8c20-c694-488e-8bf4-64aa019ca13f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:26.365100 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f81bd5-99ef-40ff-b710-692d7ae8c923 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:26.374198 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:26.459780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84498aa0-3a47-408e-908b-2fa4c0bd899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:26.460726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498aa0-3a47-408e-908b-2fa4c0bd899f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.461168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498aa0-3a47-408e-908b-2fa4c0bd899f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.461652 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498aa0-3a47-408e-908b-2fa4c0bd899f None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.462634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84498aa0-3a47-408e-908b-2fa4c0bd899f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:26.463085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84498aa0-3a47-408e-908b-2fa4c0bd899f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:26.464776 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84498aa0-3a47-408e-908b-2fa4c0bd899f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:26.466930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:26.470701 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce8c20-c694-488e-8bf4-64aa019ca13f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:26.500874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 371/758] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 10:02:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:26.506810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84498aa0-3a47-408e-908b-2fa4c0bd899f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:26.513533 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a3d13-df1c-480d-837f-ad5f41375cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:26.515479 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a3d13-df1c-480d-837f-ad5f41375cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.516087 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a3d13-df1c-480d-837f-ad5f41375cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.516533 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a3d13-df1c-480d-837f-ad5f41375cd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.526532 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a3d13-df1c-480d-837f-ad5f41375cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:26.529111 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a3d13-df1c-480d-837f-ad5f41375cd8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-f64a3d13-df1c-480d-837f-ad5f41375cd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:26.548617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:26.549770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:26.550785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:26.550785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:26.550785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:26.550785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:26.550785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:26.550785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:26.550785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:26.550785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:26.552595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 388/759] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:26.561515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a3d13-df1c-480d-837f-ad5f41375cd8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:26.649761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84498aa0-3a47-408e-908b-2fa4c0bd899f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:26.730953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9ddfb-411a-4945-a743-9505048544f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:26.731677 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9ddfb-411a-4945-a743-9505048544f9 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.731957 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9ddfb-411a-4945-a743-9505048544f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.732229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9ddfb-411a-4945-a743-9505048544f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.752377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a3d13-df1c-480d-837f-ad5f41375cd8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:26.756327 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9ddfb-411a-4945-a743-9505048544f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:26.757820 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9ddfb-411a-4945-a743-9505048544f9 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d7a9ddfb-411a-4945-a743-9505048544f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:26.785523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:26.786651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:26.787713 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:26.787713 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:26.787713 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:26.787713 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:26.787975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 372/760] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:26.793687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9ddfb-411a-4945-a743-9505048544f9 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:26.815273 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:26.819222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e9fcc-d00d-4d5d-a2bf-415ba5b1d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:26.820145 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e9fcc-d00d-4d5d-a2bf-415ba5b1d3ab None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.820604 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e9fcc-d00d-4d5d-a2bf-415ba5b1d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.821080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e9fcc-d00d-4d5d-a2bf-415ba5b1d3ab None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.822038 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e9fcc-d00d-4d5d-a2bf-415ba5b1d3ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:26.822522 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e9fcc-d00d-4d5d-a2bf-415ba5b1d3ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:26.824166 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e9fcc-d00d-4d5d-a2bf-415ba5b1d3ab None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:26.837752 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 389/761] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:26.839272 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7df00-9f61-4069-9dd6-b9b7477f3d8a None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.839741 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7df00-9f61-4069-9dd6-b9b7477f3d8a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.840192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7df00-9f61-4069-9dd6-b9b7477f3d8a None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.845635 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 390/762] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:26.846619 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7df00-9f61-4069-9dd6-b9b7477f3d8a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:26.870072 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:26.924282 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9ddfb-411a-4945-a743-9505048544f9 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:26.956290 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7df00-9f61-4069-9dd6-b9b7477f3d8a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:26.961543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a4625-4698-4d94-b905-2dd2731fb427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:26.962211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a4625-4698-4d94-b905-2dd2731fb427 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.962491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a4625-4698-4d94-b905-2dd2731fb427 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.962769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a4625-4698-4d94-b905-2dd2731fb427 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.963485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a4625-4698-4d94-b905-2dd2731fb427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:26.963789 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a4625-4698-4d94-b905-2dd2731fb427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:26.965616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a4625-4698-4d94-b905-2dd2731fb427 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:26.979072 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 373/763] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:26.984664 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37b0b6-f9a5-463b-beab-04b07f47a7f2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.984782 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37b0b6-f9a5-463b-beab-04b07f47a7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.985014 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37b0b6-f9a5-463b-beab-04b07f47a7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.992630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1755db-5c63-4a1a-80c7-8f26f16376ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:26.993378 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1755db-5c63-4a1a-80c7-8f26f16376ee None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:26.993663 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1755db-5c63-4a1a-80c7-8f26f16376ee None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:26.993942 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1755db-5c63-4a1a-80c7-8f26f16376ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:26.994764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1755db-5c63-4a1a-80c7-8f26f16376ee None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=1167f58a1ea3465083d67a94043066be) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:26.995078 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1755db-5c63-4a1a-80c7-8f26f16376ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:26.996493 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1755db-5c63-4a1a-80c7-8f26f16376ee None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:27.002072 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 391/764] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:26 2022] GET /identity/v3/role_assignments?user.id=1167f58a1ea3465083d67a94043066be&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:27.003194 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8fa3-b1a2-4952-ae90-def38ef16c09 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:27.003517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8fa3-b1a2-4952-ae90-def38ef16c09 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:27.003797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8fa3-b1a2-4952-ae90-def38ef16c09 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:27.009279 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 392/765] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:27.009279 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8fa3-b1a2-4952-ae90-def38ef16c09 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:27.009672 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ce37b0b6-f9a5-463b-beab-04b07f47a7f2 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:27.010969 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ce37b0b6-f9a5-463b-beab-04b07f47a7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:27.101301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 374/766] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:27.102888 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec5594-1e1f-45a4-a897-6fc92ac52f27 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:27.103197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec5594-1e1f-45a4-a897-6fc92ac52f27 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:27.103489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec5594-1e1f-45a4-a897-6fc92ac52f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:27.119009 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:27.137970 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e1ec5594-1e1f-45a4-a897-6fc92ac52f27 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:27.138741 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:27.139544 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e1ec5594-1e1f-45a4-a897-6fc92ac52f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:27.162756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8fa3-b1a2-4952-ae90-def38ef16c09 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:27.205634 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5df07e-3cf5-4710-ac41-bec469b14f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:27.208054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df07e-3cf5-4710-ac41-bec469b14f1f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:27.208569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df07e-3cf5-4710-ac41-bec469b14f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:27.209246 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df07e-3cf5-4710-ac41-bec469b14f1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:27.218632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5df07e-3cf5-4710-ac41-bec469b14f1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:27.221140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5df07e-3cf5-4710-ac41-bec469b14f1f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:27.232932 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 375/767] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:27.232932 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec5594-1e1f-45a4-a897-6fc92ac52f27 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-da5df07e-3cf5-4710-ac41-bec469b14f1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:27.252809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:27.254361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:27.255379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:27.255379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:27.255379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:27.255379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:27.255379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:27.255379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:27.255379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:27.255379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:27.255379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 393/768] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:27.256663 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5df07e-3cf5-4710-ac41-bec469b14f1f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:27.363193 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec5594-1e1f-45a4-a897-6fc92ac52f27 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:27.390665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5df07e-3cf5-4710-ac41-bec469b14f1f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:27.399299 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a18cb9-cfd1-4a52-928f-2a2626faa62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:27.400446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a18cb9-cfd1-4a52-928f-2a2626faa62a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:27.401014 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a18cb9-cfd1-4a52-928f-2a2626faa62a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:27.401508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a18cb9-cfd1-4a52-928f-2a2626faa62a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:27.402371 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a18cb9-cfd1-4a52-928f-2a2626faa62a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:27.403965 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a18cb9-cfd1-4a52-928f-2a2626faa62a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:27.406122 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-43a18cb9-cfd1-4a52-928f-2a2626faa62a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:27.417508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:27.418481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 10:02:27.419572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:27.422475 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 376/769] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Jul 5 10:02:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:27.423459 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a18cb9-cfd1-4a52-928f-2a2626faa62a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:27.435292 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e79e4-53d9-4fec-9eae-34c1035f3f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:27.436093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e79e4-53d9-4fec-9eae-34c1035f3f26 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:27.436376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e79e4-53d9-4fec-9eae-34c1035f3f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:27.436651 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e79e4-53d9-4fec-9eae-34c1035f3f26 None admin] PATH_INFO: `/v3/services/network` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:27.437502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e79e4-53d9-4fec-9eae-34c1035f3f26 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:27.438775 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e79e4-53d9-4fec-9eae-34c1035f3f26 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ae2e79e4-53d9-4fec-9eae-34c1035f3f26 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:27.451903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:27.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 10:02:27.454333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:27.460905 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 394/770] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:27 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:27.460905 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e79e4-53d9-4fec-9eae-34c1035f3f26 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:27.467978 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:27.540731 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a18cb9-cfd1-4a52-928f-2a2626faa62a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:27.565974 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e79e4-53d9-4fec-9eae-34c1035f3f26 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:27.575805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664104f-d5b3-44da-969a-428fc26c567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:27.576662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664104f-d5b3-44da-969a-428fc26c567b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:27.577121 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664104f-d5b3-44da-969a-428fc26c567b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:27.577572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664104f-d5b3-44da-969a-428fc26c567b None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:27.578503 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664104f-d5b3-44da-969a-428fc26c567b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:27.578958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664104f-d5b3-44da-969a-428fc26c567b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:27.580595 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664104f-d5b3-44da-969a-428fc26c567b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:27.601422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 377/771] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:27.602649 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664104f-d5b3-44da-969a-428fc26c567b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:27.609953 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cd69f-3544-402d-b510-688eb0aa26eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:27.610949 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cd69f-3544-402d-b510-688eb0aa26eb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:27.611367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cd69f-3544-402d-b510-688eb0aa26eb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:27.611778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cd69f-3544-402d-b510-688eb0aa26eb None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:27.612965 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cd69f-3544-402d-b510-688eb0aa26eb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:27.613440 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cd69f-3544-402d-b510-688eb0aa26eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:27.615898 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cd69f-3544-402d-b510-688eb0aa26eb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:27.623930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 395/772] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 10:02:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:27.624777 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cd69f-3544-402d-b510-688eb0aa26eb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:27.675553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:27.712979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:27.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664104f-d5b3-44da-969a-428fc26c567b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:27.747667 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cd69f-3544-402d-b510-688eb0aa26eb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:27.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92643c24-3886-4582-bfd1-90f4185d1863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:27.758163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92643c24-3886-4582-bfd1-90f4185d1863 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:27.758652 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92643c24-3886-4582-bfd1-90f4185d1863 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:27.759132 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92643c24-3886-4582-bfd1-90f4185d1863 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:27.760032 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92643c24-3886-4582-bfd1-90f4185d1863 None admin] RBAC: Adding query filter params (name=network) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:27.760538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92643c24-3886-4582-bfd1-90f4185d1863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:27.762145 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92643c24-3886-4582-bfd1-90f4185d1863 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:27.772152 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 378/773] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:27.773243 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92643c24-3886-4582-bfd1-90f4185d1863 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:27.783747 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610798de-33c1-4bfa-affe-989fc1ebbb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:27.785190 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610798de-33c1-4bfa-affe-989fc1ebbb1f None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:27.785848 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610798de-33c1-4bfa-affe-989fc1ebbb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:27.785848 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610798de-33c1-4bfa-affe-989fc1ebbb1f None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/1ff81129f179478d901b590a5be64f38/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:27.787930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610798de-33c1-4bfa-affe-989fc1ebbb1f None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=1ff81129f179478d901b590a5be64f38, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:27.789394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610798de-33c1-4bfa-affe-989fc1ebbb1f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:27.813001 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 396/774] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:02:27 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/1ff81129f179478d901b590a5be64f38/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:02:27.813001 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610798de-33c1-4bfa-affe-989fc1ebbb1f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:27.920941 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610798de-33c1-4bfa-affe-989fc1ebbb1f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:27.938596 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92643c24-3886-4582-bfd1-90f4185d1863 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:27.955443 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:27.967632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682235c1-1dcf-45fb-8673-416f614b8059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:27.970809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682235c1-1dcf-45fb-8673-416f614b8059 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:27.971573 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682235c1-1dcf-45fb-8673-416f614b8059 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:27.972765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682235c1-1dcf-45fb-8673-416f614b8059 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:27.974144 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682235c1-1dcf-45fb-8673-416f614b8059 None admin] RBAC: Adding query filter params (type=network) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:27.974818 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682235c1-1dcf-45fb-8673-416f614b8059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:27.977320 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682235c1-1dcf-45fb-8673-416f614b8059 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:27.986551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 397/775] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:27.997828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682235c1-1dcf-45fb-8673-416f614b8059 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:28.000257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:28.022639 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62a0ba-fa6a-4d0f-9ba2-c78e78ea57d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:28.023382 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62a0ba-fa6a-4d0f-9ba2-c78e78ea57d7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:28.023678 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62a0ba-fa6a-4d0f-9ba2-c78e78ea57d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:28.023961 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62a0ba-fa6a-4d0f-9ba2-c78e78ea57d7 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:28.024686 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62a0ba-fa6a-4d0f-9ba2-c78e78ea57d7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:28.025024 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62a0ba-fa6a-4d0f-9ba2-c78e78ea57d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:28.026445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62a0ba-fa6a-4d0f-9ba2-c78e78ea57d7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:28.037076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 379/776] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 10:02:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:28.043873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62a0ba-fa6a-4d0f-9ba2-c78e78ea57d7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:28.149483 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682235c1-1dcf-45fb-8673-416f614b8059 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:28.184879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62a0ba-fa6a-4d0f-9ba2-c78e78ea57d7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:28.190299 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c65c-febf-446f-adbe-8474c0792207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:28.191330 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c65c-febf-446f-adbe-8474c0792207 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:28.191819 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c65c-febf-446f-adbe-8474c0792207 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:28.192441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c65c-febf-446f-adbe-8474c0792207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:28.194018 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0c65c-febf-446f-adbe-8474c0792207 None admin] RBAC: Adding query filter params (interface=public, service_id=12efeadc14b24ebeb9c6f01537d03ef4, region_id=RegionOne) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:28.194546 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0c65c-febf-446f-adbe-8474c0792207 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:28.197147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0c65c-febf-446f-adbe-8474c0792207 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:28.213126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 398/777] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 10:02:27 2022] GET /identity/v3/endpoints?service_id=12efeadc14b24ebeb9c6f01537d03ef4&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:28.216783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c65c-febf-446f-adbe-8474c0792207 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:28.227052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b397-09f2-4f62-b388-ec6619a6e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:28.227765 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b397-09f2-4f62-b388-ec6619a6e0fb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:28.228055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b397-09f2-4f62-b388-ec6619a6e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:28.228328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b397-09f2-4f62-b388-ec6619a6e0fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:28.229259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17b397-09f2-4f62-b388-ec6619a6e0fb None admin] RBAC: Adding query filter params (interface=public, service_id=f0d12d974a634adc8bf46d9511cee0ec, region_id=RegionOne) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:28.229580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17b397-09f2-4f62-b388-ec6619a6e0fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:28.231033 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17b397-09f2-4f62-b388-ec6619a6e0fb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:28.240268 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 380/778] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 10:02:28 2022] GET /identity/v3/endpoints?service_id=f0d12d974a634adc8bf46d9511cee0ec&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:28.245637 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b397-09f2-4f62-b388-ec6619a6e0fb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:28.294606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:28.307687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:28.348780 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c65c-febf-446f-adbe-8474c0792207 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:28.365331 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b397-09f2-4f62-b388-ec6619a6e0fb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:28.392442 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d43137-db15-469f-b5c3-43774e10d04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:28.393429 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43137-db15-469f-b5c3-43774e10d04b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:28.394158 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43137-db15-469f-b5c3-43774e10d04b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:28.394549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43137-db15-469f-b5c3-43774e10d04b None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:28.395662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d43137-db15-469f-b5c3-43774e10d04b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:28.397657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d43137-db15-469f-b5c3-43774e10d04b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:28.417845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336171ad-4863-4679-b941-22f501ad8ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:28.418794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336171ad-4863-4679-b941-22f501ad8ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:28.419504 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336171ad-4863-4679-b941-22f501ad8ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:28.419667 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 399/779] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 10:02:28 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:28.420132 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336171ad-4863-4679-b941-22f501ad8ef2 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:28.420997 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336171ad-4863-4679-b941-22f501ad8ef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:28.422524 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336171ad-4863-4679-b941-22f501ad8ef2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:28.430713 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 381/780] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 10:02:28 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:28.692612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b48dc-adf7-440a-a64b-80045f91855c None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:28.693342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b48dc-adf7-440a-a64b-80045f91855c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:28.693855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b48dc-adf7-440a-a64b-80045f91855c None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:28.695755 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 400/781] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:28.701030 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2df9c-10b6-40be-a3d7-177165996e92 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:28.701323 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2df9c-10b6-40be-a3d7-177165996e92 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:28.701606 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2df9c-10b6-40be-a3d7-177165996e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:28.719508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-82c2df9c-10b6-40be-a3d7-177165996e92 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:28.720727 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-82c2df9c-10b6-40be-a3d7-177165996e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:28.791685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 382/782] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:28.815082 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b48dc-adf7-440a-a64b-80045f91855c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:28.946301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b48dc-adf7-440a-a64b-80045f91855c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:28.976420 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:28.993615 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3940387-e1fb-4989-9535-83785b46be0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:28.994483 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3940387-e1fb-4989-9535-83785b46be0a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:28.994778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3940387-e1fb-4989-9535-83785b46be0a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:28.995062 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3940387-e1fb-4989-9535-83785b46be0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:29.009785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3940387-e1fb-4989-9535-83785b46be0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e3940387-e1fb-4989-9535-83785b46be0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:29.020375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:29.021377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:29.022629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 401/783] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:29.028167 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2df9c-10b6-40be-a3d7-177165996e92 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:29.082863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:29.138473 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2df9c-10b6-40be-a3d7-177165996e92 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:29.173432 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e0df7-9b11-4f59-94df-d59eb17d663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:29.174108 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0df7-9b11-4f59-94df-d59eb17d663d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:29.174396 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0df7-9b11-4f59-94df-d59eb17d663d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:29.174676 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0df7-9b11-4f59-94df-d59eb17d663d None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:29.175952 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e0df7-9b11-4f59-94df-d59eb17d663d None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:29.176317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e0df7-9b11-4f59-94df-d59eb17d663d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:29.177774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e0df7-9b11-4f59-94df-d59eb17d663d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:29.186737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 383/784] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:29.192819 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3940387-e1fb-4989-9535-83785b46be0a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:29.317675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3940387-e1fb-4989-9535-83785b46be0a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:29.360018 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b93fba-8831-417b-9aa9-209497f82ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:29.360827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b93fba-8831-417b-9aa9-209497f82ffc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:29.361139 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b93fba-8831-417b-9aa9-209497f82ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:29.361420 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b93fba-8831-417b-9aa9-209497f82ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:29.366762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14210d-456c-43e0-9460-4cca06e62a95 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:29.367456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14210d-456c-43e0-9460-4cca06e62a95 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:29.367968 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14210d-456c-43e0-9460-4cca06e62a95 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:29.370197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 384/785] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:29.376718 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c1942-a70a-437a-a914-09f50e865e6b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:29.376862 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b93fba-8831-417b-9aa9-209497f82ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:29.377084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c1942-a70a-437a-a914-09f50e865e6b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:29.377322 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c1942-a70a-437a-a914-09f50e865e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:29.378302 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b93fba-8831-417b-9aa9-209497f82ffc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:29.403754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-767c1942-a70a-437a-a914-09f50e865e6b None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:29.404985 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-767c1942-a70a-437a-a914-09f50e865e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-00b93fba-8831-417b-9aa9-209497f82ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:29.416857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:29.417756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:29.419066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:29.419066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:29.419066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:29.419066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:29.419066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 402/786] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:29.426197 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b93fba-8831-417b-9aa9-209497f82ffc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:29.466047 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:29.496801 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 385/787] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:29.559024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b93fba-8831-417b-9aa9-209497f82ffc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:29.574617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c1942-a70a-437a-a914-09f50e865e6b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:29.604586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a23f55-2cc3-4610-81de-165ba6d39d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:29.605906 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a23f55-2cc3-4610-81de-165ba6d39d1f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:29.606636 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a23f55-2cc3-4610-81de-165ba6d39d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:29.607386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a23f55-2cc3-4610-81de-165ba6d39d1f None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:29.608376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a23f55-2cc3-4610-81de-165ba6d39d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:29.608927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a23f55-2cc3-4610-81de-165ba6d39d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:29.610674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a23f55-2cc3-4610-81de-165ba6d39d1f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:29.622744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:29.634848 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 403/788] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:29.639885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a23f55-2cc3-4610-81de-165ba6d39d1f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:29.763854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c1942-a70a-437a-a914-09f50e865e6b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:29.793935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:29.806048 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a23f55-2cc3-4610-81de-165ba6d39d1f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:29.830811 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191e1bc-af78-4ac0-a7e9-75df0cf867b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:29.832068 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e1bc-af78-4ac0-a7e9-75df0cf867b1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:29.832348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e1bc-af78-4ac0-a7e9-75df0cf867b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:29.832624 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e1bc-af78-4ac0-a7e9-75df0cf867b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:29.853704 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191e1bc-af78-4ac0-a7e9-75df0cf867b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-2191e1bc-af78-4ac0-a7e9-75df0cf867b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:29.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:29.866579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:29.868031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 386/789] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:29.873614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191e1bc-af78-4ac0-a7e9-75df0cf867b1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:29.885728 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ef9a7-b41a-4a48-8e6b-55112a370b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:29.886595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ef9a7-b41a-4a48-8e6b-55112a370b35 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:29.886888 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ef9a7-b41a-4a48-8e6b-55112a370b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:29.887173 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ef9a7-b41a-4a48-8e6b-55112a370b35 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:29.910579 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ef9a7-b41a-4a48-8e6b-55112a370b35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:29.912080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ef9a7-b41a-4a48-8e6b-55112a370b35 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-6a1ef9a7-b41a-4a48-8e6b-55112a370b35 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:29.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:29.936607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:29.937586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:29.937586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:29.937586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:29.937586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:29.937586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:29.937586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:29.937586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:29.937586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:29.937586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:29.937586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:29.941108 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 404/790] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 10:02:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:29.951364 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ef9a7-b41a-4a48-8e6b-55112a370b35 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:30.105985 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:30.117957 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191e1bc-af78-4ac0-a7e9-75df0cf867b1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:30.161494 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ef9a7-b41a-4a48-8e6b-55112a370b35 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:30.179773 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad096678-2d6b-4090-aa65-f75bdb0d8b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:30.180447 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad096678-2d6b-4090-aa65-f75bdb0d8b03 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:30.180727 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad096678-2d6b-4090-aa65-f75bdb0d8b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:30.181031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad096678-2d6b-4090-aa65-f75bdb0d8b03 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:30.181781 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad096678-2d6b-4090-aa65-f75bdb0d8b03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:30.182087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad096678-2d6b-4090-aa65-f75bdb0d8b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:30.183453 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad096678-2d6b-4090-aa65-f75bdb0d8b03 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:30.200111 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 387/791] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:30.205023 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad096678-2d6b-4090-aa65-f75bdb0d8b03 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:30.249623 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b77250-5992-43f3-8f9f-cd3376afe106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:30.250319 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b77250-5992-43f3-8f9f-cd3376afe106 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:30.250614 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b77250-5992-43f3-8f9f-cd3376afe106 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:30.250893 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b77250-5992-43f3-8f9f-cd3376afe106 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:30.251742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b77250-5992-43f3-8f9f-cd3376afe106 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:30.252055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b77250-5992-43f3-8f9f-cd3376afe106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:30.253581 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b77250-5992-43f3-8f9f-cd3376afe106 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:30.305600 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 405/792] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 10:02:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:30.309086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad096678-2d6b-4090-aa65-f75bdb0d8b03 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:30.313865 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b77250-5992-43f3-8f9f-cd3376afe106 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:30.336180 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:30.346432 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163df4e-efca-41e2-84c3-2c6345a1fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:30.348120 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163df4e-efca-41e2-84c3-2c6345a1fc1a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:30.348642 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163df4e-efca-41e2-84c3-2c6345a1fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:30.349119 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163df4e-efca-41e2-84c3-2c6345a1fc1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:30.360154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163df4e-efca-41e2-84c3-2c6345a1fc1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:30.362025 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163df4e-efca-41e2-84c3-2c6345a1fc1a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-6163df4e-efca-41e2-84c3-2c6345a1fc1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:30.389827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:30.390946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:30.392021 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:30.392021 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:30.392021 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:30.392021 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:30.393731 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 388/793] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:30.399256 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163df4e-efca-41e2-84c3-2c6345a1fc1a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:30.421259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:30.448378 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b77250-5992-43f3-8f9f-cd3376afe106 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:30.505993 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8a90-8a8a-4948-bda4-2a1c0613eddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:30.506806 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8a90-8a8a-4948-bda4-2a1c0613eddf None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:30.507091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8a90-8a8a-4948-bda4-2a1c0613eddf None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:30.507370 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8a90-8a8a-4948-bda4-2a1c0613eddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:30.525952 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8a90-8a8a-4948-bda4-2a1c0613eddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:30.527423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8a90-8a8a-4948-bda4-2a1c0613eddf None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-2a7d8a90-8a8a-4948-bda4-2a1c0613eddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:30.560560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:30.561544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:30.562428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:30.562428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:30.562428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:30.562428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:30.562428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 406/794] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:30.564449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163df4e-efca-41e2-84c3-2c6345a1fc1a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:30.568032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8a90-8a8a-4948-bda4-2a1c0613eddf None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:30.637691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d79b97-14a1-44ec-abee-97d858e772b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:30.638289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d79b97-14a1-44ec-abee-97d858e772b8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:30.638570 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d79b97-14a1-44ec-abee-97d858e772b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:30.638840 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d79b97-14a1-44ec-abee-97d858e772b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:30.639569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d79b97-14a1-44ec-abee-97d858e772b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:30.639878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d79b97-14a1-44ec-abee-97d858e772b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:30.641265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d79b97-14a1-44ec-abee-97d858e772b8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:30.655747 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 389/795] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:30.657221 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:30.661163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cbb09-e5c6-4658-af22-cafe2c13a768 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:30.661466 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cbb09-e5c6-4658-af22-cafe2c13a768 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:30.661812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cbb09-e5c6-4658-af22-cafe2c13a768 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:30.663377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 390/796] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:30.664772 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cbb09-e5c6-4658-af22-cafe2c13a768 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:30.686739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8a90-8a8a-4948-bda4-2a1c0613eddf None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:30.728239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87104bc-2271-41df-9c21-6444f7192ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:30.729533 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87104bc-2271-41df-9c21-6444f7192ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:30.730244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87104bc-2271-41df-9c21-6444f7192ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:30.731127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87104bc-2271-41df-9c21-6444f7192ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:30.732356 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87104bc-2271-41df-9c21-6444f7192ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:30.732848 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87104bc-2271-41df-9c21-6444f7192ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:30.734771 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87104bc-2271-41df-9c21-6444f7192ce6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:30.738424 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:30.752769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 407/797] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:30.754440 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806e03-883c-4add-85b2-8b01b752a2d5 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:30.754881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806e03-883c-4add-85b2-8b01b752a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:30.755309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806e03-883c-4add-85b2-8b01b752a2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:30.773496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cbb09-e5c6-4658-af22-cafe2c13a768 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:30.773950 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4f806e03-883c-4add-85b2-8b01b752a2d5 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:30.775543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4f806e03-883c-4add-85b2-8b01b752a2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:30.810935 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28219f-a222-4f36-8e24-c4bd9bf73394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:30.812790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28219f-a222-4f36-8e24-c4bd9bf73394 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:30.813569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28219f-a222-4f36-8e24-c4bd9bf73394 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:30.814170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28219f-a222-4f36-8e24-c4bd9bf73394 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:30.825050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28219f-a222-4f36-8e24-c4bd9bf73394 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:30.827398 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28219f-a222-4f36-8e24-c4bd9bf73394 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8f28219f-a222-4f36-8e24-c4bd9bf73394 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:30.845042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:30.846202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:30.847863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:30.847863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:30.847863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:30.847863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:30.847863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:30.847863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:30.847863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:30.847863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:30.847863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:30.847863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:30.852968 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 391/798] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:30.853959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28219f-a222-4f36-8e24-c4bd9bf73394 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:30.871510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 408/799] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:30.872948 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f806e03-883c-4add-85b2-8b01b752a2d5 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:30.947850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:30.978105 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28219f-a222-4f36-8e24-c4bd9bf73394 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:30.995120 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f806e03-883c-4add-85b2-8b01b752a2d5 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:31.007554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:31.014737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0eded-4877-4eff-8e19-2de753dc983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.015555 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0eded-4877-4eff-8e19-2de753dc983f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.015810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0eded-4877-4eff-8e19-2de753dc983f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.016082 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0eded-4877-4eff-8e19-2de753dc983f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.023990 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0eded-4877-4eff-8e19-2de753dc983f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:31.025479 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0eded-4877-4eff-8e19-2de753dc983f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:31.036856 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db4b1b-90ae-4dca-b47b-d82fee215559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.037552 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4b1b-90ae-4dca-b47b-d82fee215559 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.037836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4b1b-90ae-4dca-b47b-d82fee215559 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.038113 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4b1b-90ae-4dca-b47b-d82fee215559 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.038940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db4b1b-90ae-4dca-b47b-d82fee215559 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:31.039249 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db4b1b-90ae-4dca-b47b-d82fee215559 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-22c0eded-4877-4eff-8e19-2de753dc983f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:31.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:31.041263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:31.047317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:31.047317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:31.047317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:31.047317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:31.047317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:31.047317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:31.047317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:31.047317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:31.047754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db4b1b-90ae-4dca-b47b-d82fee215559 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:31.047827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 392/800] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:31.047827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0eded-4877-4eff-8e19-2de753dc983f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:31.065204 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 409/801] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 10:02:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:31.066543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daee601-44bf-4a1b-9c76-ec59cba7a27a None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.066837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daee601-44bf-4a1b-9c76-ec59cba7a27a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.067116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daee601-44bf-4a1b-9c76-ec59cba7a27a None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.068336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 410/802] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:31.069043 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daee601-44bf-4a1b-9c76-ec59cba7a27a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:31.147410 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0eded-4877-4eff-8e19-2de753dc983f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:31.167003 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daee601-44bf-4a1b-9c76-ec59cba7a27a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:31.180992 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8e218-2995-441f-8adb-2ac81cff587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.181168 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:31.181785 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8e218-2995-441f-8adb-2ac81cff587c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.182099 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8e218-2995-441f-8adb-2ac81cff587c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.182483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8e218-2995-441f-8adb-2ac81cff587c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.192829 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8e218-2995-441f-8adb-2ac81cff587c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:31.200390 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b6e16-8072-4592-8086-c1d5771b14f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-72e8e218-2995-441f-8adb-2ac81cff587c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:31.200536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:31.201633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:31.202469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:31.203525 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b6e16-8072-4592-8086-c1d5771b14f2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.203525 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b6e16-8072-4592-8086-c1d5771b14f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.203525 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b6e16-8072-4592-8086-c1d5771b14f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.203710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 393/803] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:31.203779 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b6e16-8072-4592-8086-c1d5771b14f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:31.203779 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b6e16-8072-4592-8086-c1d5771b14f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:31.203899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa736b-bf6f-4ec9-b30a-3e6328ae80fe None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.203899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa736b-bf6f-4ec9-b30a-3e6328ae80fe None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.203899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa736b-bf6f-4ec9-b30a-3e6328ae80fe None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.204081 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b6e16-8072-4592-8086-c1d5771b14f2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:31.209135 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 394/804] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:31.209898 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa736b-bf6f-4ec9-b30a-3e6328ae80fe None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:31.217379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 411/805] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:31.218437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4ed6-c034-4d2b-a100-7dd2c34a7d76 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.218730 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4ed6-c034-4d2b-a100-7dd2c34a7d76 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.219003 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4ed6-c034-4d2b-a100-7dd2c34a7d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.234901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-181f4ed6-c034-4d2b-a100-7dd2c34a7d76 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:31.236072 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-181f4ed6-c034-4d2b-a100-7dd2c34a7d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:31.263229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:31.304520 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 412/806] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:31.305388 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4ed6-c034-4d2b-a100-7dd2c34a7d76 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:31.322645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa736b-bf6f-4ec9-b30a-3e6328ae80fe None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:31.357061 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52201126-41eb-4e48-a083-a75adcc61d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.357847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52201126-41eb-4e48-a083-a75adcc61d25 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.358176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52201126-41eb-4e48-a083-a75adcc61d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.358455 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52201126-41eb-4e48-a083-a75adcc61d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.368058 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52201126-41eb-4e48-a083-a75adcc61d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:31.369541 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52201126-41eb-4e48-a083-a75adcc61d25 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-52201126-41eb-4e48-a083-a75adcc61d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:31.386319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:31.387187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:31.388086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:31.388086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:31.388086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:31.388086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:31.388086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 395/807] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:31.388686 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd4793-3714-422f-b984-3d4bf6a6781f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.389004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd4793-3714-422f-b984-3d4bf6a6781f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.389266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd4793-3714-422f-b984-3d4bf6a6781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.405609 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2dfd4793-3714-422f-b984-3d4bf6a6781f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:31.406800 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2dfd4793-3714-422f-b984-3d4bf6a6781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:31.407211 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4ed6-c034-4d2b-a100-7dd2c34a7d76 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:31.410827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:31.444397 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f5d3b-8a05-4387-ab13-7d51643664f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.445121 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f5d3b-8a05-4387-ab13-7d51643664f3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.445408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f5d3b-8a05-4387-ab13-7d51643664f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.445686 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f5d3b-8a05-4387-ab13-7d51643664f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.446422 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f5d3b-8a05-4387-ab13-7d51643664f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:31.446730 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f5d3b-8a05-4387-ab13-7d51643664f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:31.448099 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f5d3b-8a05-4387-ab13-7d51643664f3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:31.456124 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 413/808] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:31.457571 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f5d3b-8a05-4387-ab13-7d51643664f3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:31.473810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 396/809] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:31.474898 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd4793-3714-422f-b984-3d4bf6a6781f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:31.503085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:31.570010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd4793-3714-422f-b984-3d4bf6a6781f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:31.572149 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f5d3b-8a05-4387-ab13-7d51643664f3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:31.603152 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e791d4-f797-4972-9ff7-99bec7ac83b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.603936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e791d4-f797-4972-9ff7-99bec7ac83b5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.604219 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e791d4-f797-4972-9ff7-99bec7ac83b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.604457 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2259f-489a-4c36-838f-5d333fc06e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.604564 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e791d4-f797-4972-9ff7-99bec7ac83b5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.605158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e791d4-f797-4972-9ff7-99bec7ac83b5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:31.605383 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2259f-489a-4c36-838f-5d333fc06e8e None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.605669 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2259f-489a-4c36-838f-5d333fc06e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.605948 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2259f-489a-4c36-838f-5d333fc06e8e None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/f2683e79ea804a7987642df32f03fad5/roles/0fa7c8540d8b472aace10fb2fc38b37b` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.606521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e791d4-f797-4972-9ff7-99bec7ac83b5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f4e791d4-f797-4972-9ff7-99bec7ac83b5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:31.618097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:31.619085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:31.619984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 397/810] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:31 2022] GET /identity/v3/services/network => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:31.620753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2259f-489a-4c36-838f-5d333fc06e8e None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=f2683e79ea804a7987642df32f03fad5, role_id=0fa7c8540d8b472aace10fb2fc38b37b)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:31.620832 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e791d4-f797-4972-9ff7-99bec7ac83b5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:31.621388 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2259f-489a-4c36-838f-5d333fc06e8e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:31.636299 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 414/811] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:02:31 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/f2683e79ea804a7987642df32f03fad5/roles/0fa7c8540d8b472aace10fb2fc38b37b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:02:31.637206 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2259f-489a-4c36-838f-5d333fc06e8e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:31.662193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:31.730947 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:31.738604 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e791d4-f797-4972-9ff7-99bec7ac83b5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:31.759303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2259f-489a-4c36-838f-5d333fc06e8e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:31.778698 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9487034-a349-4a51-9505-2614a5635d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.779693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9487034-a349-4a51-9505-2614a5635d0a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.779973 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9487034-a349-4a51-9505-2614a5635d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.780249 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9487034-a349-4a51-9505-2614a5635d0a None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.781003 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9487034-a349-4a51-9505-2614a5635d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:31.781312 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9487034-a349-4a51-9505-2614a5635d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:31.782689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9487034-a349-4a51-9505-2614a5635d0a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:31.798160 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 398/812] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:31.799014 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9487034-a349-4a51-9505-2614a5635d0a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:31.801240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e22673-8688-4408-836a-b12564d6adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.802298 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22673-8688-4408-836a-b12564d6adc5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.802743 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22673-8688-4408-836a-b12564d6adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.803084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22673-8688-4408-836a-b12564d6adc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.813935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e22673-8688-4408-836a-b12564d6adc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:31.815396 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e22673-8688-4408-836a-b12564d6adc5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-31e22673-8688-4408-836a-b12564d6adc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:31.834091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:31.835058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:31.835935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:31.835935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:31.835935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:31.835935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:31.835935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 415/813] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:31.836231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e22673-8688-4408-836a-b12564d6adc5 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:31.906249 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:31.907243 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9487034-a349-4a51-9505-2614a5635d0a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:31.942701 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e22673-8688-4408-836a-b12564d6adc5 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:31.946433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ab4d2-3346-45a4-b0d1-977febdfc40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.947256 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ab4d2-3346-45a4-b0d1-977febdfc40d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.947539 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ab4d2-3346-45a4-b0d1-977febdfc40d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.947817 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ab4d2-3346-45a4-b0d1-977febdfc40d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.948469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ab4d2-3346-45a4-b0d1-977febdfc40d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:31.949873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ab4d2-3346-45a4-b0d1-977febdfc40d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8c5ab4d2-3346-45a4-b0d1-977febdfc40d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:31.964304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:31.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:31.966170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 399/814] 10.222.0.13 () {56 vars in 1129 bytes} [Tue Jul 5 10:02:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:31.967005 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ab4d2-3346-45a4-b0d1-977febdfc40d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:31.982727 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d3b04-a762-495a-b44f-56db4d307d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:31.983324 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d3b04-a762-495a-b44f-56db4d307d8a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:31.983624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d3b04-a762-495a-b44f-56db4d307d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:31.983878 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d3b04-a762-495a-b44f-56db4d307d8a None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:31.984641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d3b04-a762-495a-b44f-56db4d307d8a None admin] RBAC: Adding query filter params (name=network) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:31.984912 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d3b04-a762-495a-b44f-56db4d307d8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:31.986262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d3b04-a762-495a-b44f-56db4d307d8a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:31.991593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:31.992064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 416/815] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:31.992964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d3b04-a762-495a-b44f-56db4d307d8a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:32.082766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ab4d2-3346-45a4-b0d1-977febdfc40d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:32.101488 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d3b04-a762-495a-b44f-56db4d307d8a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:32.121622 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15059ed-635a-4ed0-b854-f5b14c267b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:32.122420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15059ed-635a-4ed0-b854-f5b14c267b39 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:32.122703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15059ed-635a-4ed0-b854-f5b14c267b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:32.122978 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15059ed-635a-4ed0-b854-f5b14c267b39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:32.130441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:32.131255 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15059ed-635a-4ed0-b854-f5b14c267b39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:32.132698 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15059ed-635a-4ed0-b854-f5b14c267b39 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:32.136400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3815f6-3610-4233-92c3-2b9515206109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:32.137091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3815f6-3610-4233-92c3-2b9515206109 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:32.137376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3815f6-3610-4233-92c3-2b9515206109 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:32.137649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3815f6-3610-4233-92c3-2b9515206109 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:32.138360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3815f6-3610-4233-92c3-2b9515206109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:32.138666 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3815f6-3610-4233-92c3-2b9515206109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:32.140012 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3815f6-3610-4233-92c3-2b9515206109 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e15059ed-635a-4ed0-b854-f5b14c267b39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:32.147493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:32.148877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:32.149873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:32.149873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:32.149873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:32.149873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:32.149873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:32.149873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:32.149873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:32.149873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:32.149873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 400/816] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:32.150482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15059ed-635a-4ed0-b854-f5b14c267b39 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:32.157071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 417/817] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:32.158196 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3815f6-3610-4233-92c3-2b9515206109 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:32.232287 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:32.254705 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15059ed-635a-4ed0-b854-f5b14c267b39 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:32.265077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3815f6-3610-4233-92c3-2b9515206109 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:32.299366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4178e6-f4e8-4b60-bf7e-bd4e5230ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:32.300233 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4178e6-f4e8-4b60-bf7e-bd4e5230ad17 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:32.300676 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4178e6-f4e8-4b60-bf7e-bd4e5230ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:32.301058 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4178e6-f4e8-4b60-bf7e-bd4e5230ad17 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:32.301588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6421ae-c62b-4d81-97ee-4ab168ba9229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:32.301891 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4178e6-f4e8-4b60-bf7e-bd4e5230ad17 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:32.302252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6421ae-c62b-4d81-97ee-4ab168ba9229 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:32.302364 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4178e6-f4e8-4b60-bf7e-bd4e5230ad17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:32.302532 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6421ae-c62b-4d81-97ee-4ab168ba9229 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:32.302806 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6421ae-c62b-4d81-97ee-4ab168ba9229 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:32.303495 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6421ae-c62b-4d81-97ee-4ab168ba9229 None admin] RBAC: Adding query filter params (type=network) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:32.303799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6421ae-c62b-4d81-97ee-4ab168ba9229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:32.303953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4178e6-f4e8-4b60-bf7e-bd4e5230ad17 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:32.305168 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6421ae-c62b-4d81-97ee-4ab168ba9229 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:32.313560 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 401/818] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 10:02:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:32.313560 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4178e6-f4e8-4b60-bf7e-bd4e5230ad17 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:32.313797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 418/819] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:32.313797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6421ae-c62b-4d81-97ee-4ab168ba9229 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:32.371632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:32.419093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6421ae-c62b-4d81-97ee-4ab168ba9229 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:32.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4178e6-f4e8-4b60-bf7e-bd4e5230ad17 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:32.455409 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4b882-a721-4fb5-9315-0feaea7b06a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:32.456993 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b882-a721-4fb5-9315-0feaea7b06a3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:32.457279 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b882-a721-4fb5-9315-0feaea7b06a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:32.457558 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b882-a721-4fb5-9315-0feaea7b06a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:32.459751 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea7fb2-20f1-45c4-a7e7-b0fd09845fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:32.460414 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea7fb2-20f1-45c4-a7e7-b0fd09845fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:32.460693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea7fb2-20f1-45c4-a7e7-b0fd09845fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:32.460991 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea7fb2-20f1-45c4-a7e7-b0fd09845fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:32.461770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea7fb2-20f1-45c4-a7e7-b0fd09845fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:32.462078 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea7fb2-20f1-45c4-a7e7-b0fd09845fd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:32.463505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea7fb2-20f1-45c4-a7e7-b0fd09845fd8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:32.465166 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4b882-a721-4fb5-9315-0feaea7b06a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:32.466594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4b882-a721-4fb5-9315-0feaea7b06a3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:32.480918 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 402/820] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:32.480918 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea7fb2-20f1-45c4-a7e7-b0fd09845fd8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-cfd4b882-a721-4fb5-9315-0feaea7b06a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:32.481503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:32.482372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:32.483287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:32.483287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:32.483287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:32.483287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:32.483287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:32.483287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:32.483287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:32.483287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:32.483287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:02:32.483287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:32.483287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 419/821] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 10:02:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:32.483864 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4b882-a721-4fb5-9315-0feaea7b06a3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:32.485544 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:32.591697 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea7fb2-20f1-45c4-a7e7-b0fd09845fd8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:32.597421 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4b882-a721-4fb5-9315-0feaea7b06a3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:32.613252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:32.629964 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f95f02-40f9-43b0-b98a-420d7399f085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:32.630813 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f95f02-40f9-43b0-b98a-420d7399f085 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:32.631099 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f95f02-40f9-43b0-b98a-420d7399f085 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:32.631383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f95f02-40f9-43b0-b98a-420d7399f085 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:32.632170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f95f02-40f9-43b0-b98a-420d7399f085 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:32.632482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f95f02-40f9-43b0-b98a-420d7399f085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:32.632669 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a85a99-5643-4e43-be39-4275f2d2453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:32.633369 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a85a99-5643-4e43-be39-4275f2d2453f None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:32.633660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a85a99-5643-4e43-be39-4275f2d2453f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:32.633879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f95f02-40f9-43b0-b98a-420d7399f085 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:32.633973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a85a99-5643-4e43-be39-4275f2d2453f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:32.634670 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a85a99-5643-4e43-be39-4275f2d2453f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:32.636021 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a85a99-5643-4e43-be39-4275f2d2453f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:32.643554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 403/822] 10.222.0.13 () {56 vars in 1124 bytes} [Tue Jul 5 10:02:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:32.643554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f95f02-40f9-43b0-b98a-420d7399f085 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:32.663685 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 420/823] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 10:02:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:32.670144 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a85a99-5643-4e43-be39-4275f2d2453f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:32.732919 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:32.775615 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f95f02-40f9-43b0-b98a-420d7399f085 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:32.815189 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a85a99-5643-4e43-be39-4275f2d2453f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:32.817959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94a76f-b857-42d2-81b9-37873e2490cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:32.819128 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94a76f-b857-42d2-81b9-37873e2490cf None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:32.819622 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94a76f-b857-42d2-81b9-37873e2490cf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:32.820079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94a76f-b857-42d2-81b9-37873e2490cf None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/1167f58a1ea3465083d67a94043066be/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:32.822409 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94a76f-b857-42d2-81b9-37873e2490cf None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=1167f58a1ea3465083d67a94043066be, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:32.824713 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94a76f-b857-42d2-81b9-37873e2490cf None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:32.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 404/824] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:02:32 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/1167f58a1ea3465083d67a94043066be/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:02:32.846046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94a76f-b857-42d2-81b9-37873e2490cf None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:32.854876 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c23f53-96c2-47f0-b5da-ab9a9edf67dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:32.856016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23f53-96c2-47f0-b5da-ab9a9edf67dd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:32.856505 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23f53-96c2-47f0-b5da-ab9a9edf67dd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:32.857042 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23f53-96c2-47f0-b5da-ab9a9edf67dd None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:32.858367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c23f53-96c2-47f0-b5da-ab9a9edf67dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:32.858940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c23f53-96c2-47f0-b5da-ab9a9edf67dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:32.860798 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c23f53-96c2-47f0-b5da-ab9a9edf67dd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:32.882057 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 421/825] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 10:02:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:32.888583 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c23f53-96c2-47f0-b5da-ab9a9edf67dd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:32.935107 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:32.968301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94a76f-b857-42d2-81b9-37873e2490cf None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:33.006243 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:33.022016 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3ec8b-dc3a-45d6-9f5b-0bcadb276662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:33.023439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3ec8b-dc3a-45d6-9f5b-0bcadb276662 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:33.023840 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3ec8b-dc3a-45d6-9f5b-0bcadb276662 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:33.024473 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3ec8b-dc3a-45d6-9f5b-0bcadb276662 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:33.025372 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3ec8b-dc3a-45d6-9f5b-0bcadb276662 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:33.027118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3ec8b-dc3a-45d6-9f5b-0bcadb276662 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:33.030472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c23f53-96c2-47f0-b5da-ab9a9edf67dd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:33.053710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 405/826] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 10:02:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:33.089103 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf82de7-b6b4-426e-b6d0-ac6a191eeed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:33.089823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82de7-b6b4-426e-b6d0-ac6a191eeed0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:33.090118 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82de7-b6b4-426e-b6d0-ac6a191eeed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:33.090403 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82de7-b6b4-426e-b6d0-ac6a191eeed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:33.175757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf82de7-b6b4-426e-b6d0-ac6a191eeed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:33.177696 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf82de7-b6b4-426e-b6d0-ac6a191eeed0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:33.205735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:33.299071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 422/827] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:02:33.304072 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3ec8b-dc3a-45d6-9f5b-0bcadb276662 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:33.408724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3ec8b-dc3a-45d6-9f5b-0bcadb276662 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:33.444930 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d6497-c2d2-43e3-ab62-d2a6f8f64e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:33.446079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d6497-c2d2-43e3-ab62-d2a6f8f64e92 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:33.446559 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d6497-c2d2-43e3-ab62-d2a6f8f64e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:33.447029 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d6497-c2d2-43e3-ab62-d2a6f8f64e92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:33.458564 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d6497-c2d2-43e3-ab62-d2a6f8f64e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:33.460245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d6497-c2d2-43e3-ab62-d2a6f8f64e92 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-7a0d6497-c2d2-43e3-ab62-d2a6f8f64e92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:33.478305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:33.479229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:33.480087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:33.480087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:33.480087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:33.480087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:33.482347 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 406/828] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:33.489462 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf82de7-b6b4-426e-b6d0-ac6a191eeed0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:33.590101 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf82de7-b6b4-426e-b6d0-ac6a191eeed0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:33.614261 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:33.626414 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366ed2d-3343-459a-9a64-8dcc9826f9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:33.627305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366ed2d-3343-459a-9a64-8dcc9826f9bb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:33.627811 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366ed2d-3343-459a-9a64-8dcc9826f9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:33.628096 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366ed2d-3343-459a-9a64-8dcc9826f9bb None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:33.628861 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366ed2d-3343-459a-9a64-8dcc9826f9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:33.629203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366ed2d-3343-459a-9a64-8dcc9826f9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:33.630597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366ed2d-3343-459a-9a64-8dcc9826f9bb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:33.642904 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 423/829] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:33.648576 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d6497-c2d2-43e3-ab62-d2a6f8f64e92 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:33.692600 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:33.721687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193f61-2187-4256-9583-d91775266efa None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:33.721933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193f61-2187-4256-9583-d91775266efa None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:33.722253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193f61-2187-4256-9583-d91775266efa None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:33.723905 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 424/830] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:33.729130 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b845-937d-4ab4-ab44-39eacb46ddda None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:33.729429 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b845-937d-4ab4-ab44-39eacb46ddda None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:33.729717 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b845-937d-4ab4-ab44-39eacb46ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:33.748135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6988b845-937d-4ab4-ab44-39eacb46ddda None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:33.750309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6988b845-937d-4ab4-ab44-39eacb46ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:33.755217 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d6497-c2d2-43e3-ab62-d2a6f8f64e92 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:33.790904 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65219f08-ae00-4fc9-bf61-2ada32bbfa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:33.791697 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65219f08-ae00-4fc9-bf61-2ada32bbfa86 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:33.791978 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65219f08-ae00-4fc9-bf61-2ada32bbfa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:33.792252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65219f08-ae00-4fc9-bf61-2ada32bbfa86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:33.799689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65219f08-ae00-4fc9-bf61-2ada32bbfa86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:33.802079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65219f08-ae00-4fc9-bf61-2ada32bbfa86 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-65219f08-ae00-4fc9-bf61-2ada32bbfa86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:33.819505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:33.820468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:33.821375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:33.821375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:33.821375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:33.821375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:33.821375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:33.821375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:33.821375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:33.821375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:33.821375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 407/831] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:33.826260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65219f08-ae00-4fc9-bf61-2ada32bbfa86 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:33.832994 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 425/832] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:33.850972 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b845-937d-4ab4-ab44-39eacb46ddda None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:33.931770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65219f08-ae00-4fc9-bf61-2ada32bbfa86 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:33.941275 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:33.953789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b845-937d-4ab4-ab44-39eacb46ddda None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:33.969258 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:33.969634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d140127-3166-4bea-8b53-06078b0422ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:33.971305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d140127-3166-4bea-8b53-06078b0422ec None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:33.972720 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d140127-3166-4bea-8b53-06078b0422ec None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:33.973277 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d140127-3166-4bea-8b53-06078b0422ec None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:33.974572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d140127-3166-4bea-8b53-06078b0422ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:33.975030 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d140127-3166-4bea-8b53-06078b0422ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:33.977362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d140127-3166-4bea-8b53-06078b0422ec None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:33.991799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b71f5a-0794-402e-acd8-d640eef47d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:33.992955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71f5a-0794-402e-acd8-d640eef47d3e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:33.993308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 408/833] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:33.993512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71f5a-0794-402e-acd8-d640eef47d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:33.993952 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71f5a-0794-402e-acd8-d640eef47d3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:33.998403 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d140127-3166-4bea-8b53-06078b0422ec None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:34.010871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b71f5a-0794-402e-acd8-d640eef47d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-84b71f5a-0794-402e-acd8-d640eef47d3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:34.020575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:34.021796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:02:34.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:34.025351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 426/834] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:02:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:34.033153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b71f5a-0794-402e-acd8-d640eef47d3e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:34.124004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d140127-3166-4bea-8b53-06078b0422ec None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:34.162240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b71f5a-0794-402e-acd8-d640eef47d3e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:34.172080 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63f908-6e49-4f08-b436-656358e446e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:34.173103 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f908-6e49-4f08-b436-656358e446e8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:34.173568 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f908-6e49-4f08-b436-656358e446e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:34.175667 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f908-6e49-4f08-b436-656358e446e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:34.177333 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63f908-6e49-4f08-b436-656358e446e8 None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=1ff81129f179478d901b590a5be64f38) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:34.177960 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63f908-6e49-4f08-b436-656358e446e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:34.180806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63f908-6e49-4f08-b436-656358e446e8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:34.188069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 409/835] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:33 2022] GET /identity/v3/role_assignments?user.id=1ff81129f179478d901b590a5be64f38&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:34.207738 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edddab9-f37f-4a09-95f3-e5ddadb91b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:34.208601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edddab9-f37f-4a09-95f3-e5ddadb91b73 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:34.209025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edddab9-f37f-4a09-95f3-e5ddadb91b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:34.209409 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edddab9-f37f-4a09-95f3-e5ddadb91b73 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:34.210363 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edddab9-f37f-4a09-95f3-e5ddadb91b73 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:34.210781 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edddab9-f37f-4a09-95f3-e5ddadb91b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:34.212374 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edddab9-f37f-4a09-95f3-e5ddadb91b73 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:34.223761 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 427/836] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:02:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:34.229199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63f908-6e49-4f08-b436-656358e446e8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:34.254801 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:34.359649 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63f908-6e49-4f08-b436-656358e446e8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:34.395685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3c22d-b575-45ed-9b7f-2fe5d59618ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:34.396625 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3c22d-b575-45ed-9b7f-2fe5d59618ae None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:34.397048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3c22d-b575-45ed-9b7f-2fe5d59618ae None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:34.397429 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3c22d-b575-45ed-9b7f-2fe5d59618ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:34.408491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3c22d-b575-45ed-9b7f-2fe5d59618ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:34.410156 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3c22d-b575-45ed-9b7f-2fe5d59618ae None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-92e3c22d-b575-45ed-9b7f-2fe5d59618ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:34.428745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:34.429863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:34.430953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:34.430953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:34.430953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:34.430953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:34.432601 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 410/837] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:34.437791 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edddab9-f37f-4a09-95f3-e5ddadb91b73 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:34.478333 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:34.554885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edddab9-f37f-4a09-95f3-e5ddadb91b73 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:34.591309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4108841-1f2e-4ce2-a433-027504f4ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:34.591978 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4108841-1f2e-4ce2-a433-027504f4ccfa None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:34.592265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4108841-1f2e-4ce2-a433-027504f4ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:34.592543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4108841-1f2e-4ce2-a433-027504f4ccfa None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:34.593290 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4108841-1f2e-4ce2-a433-027504f4ccfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:34.593598 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4108841-1f2e-4ce2-a433-027504f4ccfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:34.594973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4108841-1f2e-4ce2-a433-027504f4ccfa None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:34.611754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 428/838] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:34.618007 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3c22d-b575-45ed-9b7f-2fe5d59618ae None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:34.690708 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:34.722559 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3c22d-b575-45ed-9b7f-2fe5d59618ae None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:34.759020 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eca540-cb48-43b6-96aa-1f4db87fbaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:34.760099 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca540-cb48-43b6-96aa-1f4db87fbaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:34.760532 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca540-cb48-43b6-96aa-1f4db87fbaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:34.760983 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca540-cb48-43b6-96aa-1f4db87fbaf1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:34.768930 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eca540-cb48-43b6-96aa-1f4db87fbaf1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:34.770551 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eca540-cb48-43b6-96aa-1f4db87fbaf1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e1eca540-cb48-43b6-96aa-1f4db87fbaf1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:34.786077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:34.787227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:34.788387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:34.788387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:34.788387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:34.788387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:34.788387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:34.788387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:34.788387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:34.788387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:34.788387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:34.788387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:34.790605 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 411/839] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 10:02:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:34.796927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4108841-1f2e-4ce2-a433-027504f4ccfa None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:34.892540 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:34.899577 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4108841-1f2e-4ce2-a433-027504f4ccfa None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:34.936018 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e235e-da24-4896-b533-7a2caa550f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:34.936704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e235e-da24-4896-b533-7a2caa550f17 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:34.937023 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e235e-da24-4896-b533-7a2caa550f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:34.937309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e235e-da24-4896-b533-7a2caa550f17 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:34.938155 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e235e-da24-4896-b533-7a2caa550f17 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:34.938467 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e235e-da24-4896-b533-7a2caa550f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:34.939921 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e235e-da24-4896-b533-7a2caa550f17 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:34.958808 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 429/840] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 10:02:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:34.963976 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eca540-cb48-43b6-96aa-1f4db87fbaf1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:35.020405 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b866dc-b0b6-43fb-9195-2d212d0ca824 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.020595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b866dc-b0b6-43fb-9195-2d212d0ca824 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.020886 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b866dc-b0b6-43fb-9195-2d212d0ca824 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.022451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 430/841] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:02:35.027641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4a337-44de-41a6-859b-66a55242d93e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.027936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4a337-44de-41a6-859b-66a55242d93e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.028217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4a337-44de-41a6-859b-66a55242d93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.045163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c0a4a337-44de-41a6-859b-66a55242d93e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:35.046357 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c0a4a337-44de-41a6-859b-66a55242d93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:35.074717 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eca540-cb48-43b6-96aa-1f4db87fbaf1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:35.110756 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:35.119470 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ece53-df48-4e7c-9422-fbb99fbd6881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:35.120327 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ece53-df48-4e7c-9422-fbb99fbd6881 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.120765 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ece53-df48-4e7c-9422-fbb99fbd6881 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.121217 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ece53-df48-4e7c-9422-fbb99fbd6881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.124610 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 431/842] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:35.145406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4a337-44de-41a6-859b-66a55242d93e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:35.199093 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ece53-df48-4e7c-9422-fbb99fbd6881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:35.200542 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ece53-df48-4e7c-9422-fbb99fbd6881 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:35.254055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:35.281657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4a337-44de-41a6-859b-66a55242d93e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:35.330248 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 412/843] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:02:35.331512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0ee04-d906-43e2-b0cc-fcd8e5bdf162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:35.332314 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0ee04-d906-43e2-b0cc-fcd8e5bdf162 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.332598 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0ee04-d906-43e2-b0cc-fcd8e5bdf162 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.332872 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0ee04-d906-43e2-b0cc-fcd8e5bdf162 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.335547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ece53-df48-4e7c-9422-fbb99fbd6881 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:35.345065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0ee04-d906-43e2-b0cc-fcd8e5bdf162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-73a0ee04-d906-43e2-b0cc-fcd8e5bdf162 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:35.356152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:35.357136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:35.357964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 432/844] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:35.360678 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546d30-2f2a-4b84-adab-4768a775ffc8 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.360991 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546d30-2f2a-4b84-adab-4768a775ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.361272 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546d30-2f2a-4b84-adab-4768a775ffc8 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.364182 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 433/845] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:35.364909 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46546d30-2f2a-4b84-adab-4768a775ffc8 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:35.373742 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:35.454822 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ece53-df48-4e7c-9422-fbb99fbd6881 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:35.479729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46546d30-2f2a-4b84-adab-4768a775ffc8 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:35.492331 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6537cd4-56f6-4d3e-9d89-9f9a4f5dd9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:35.493406 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6537cd4-56f6-4d3e-9d89-9f9a4f5dd9bb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.493890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6537cd4-56f6-4d3e-9d89-9f9a4f5dd9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.494383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6537cd4-56f6-4d3e-9d89-9f9a4f5dd9bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.504569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6537cd4-56f6-4d3e-9d89-9f9a4f5dd9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:35.506143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6537cd4-56f6-4d3e-9d89-9f9a4f5dd9bb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:35.514592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44f098-43f2-4199-a92e-4c173c019b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:35.515665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44f098-43f2-4199-a92e-4c173c019b30 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.516220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44f098-43f2-4199-a92e-4c173c019b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.516509 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44f098-43f2-4199-a92e-4c173c019b30 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.517285 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44f098-43f2-4199-a92e-4c173c019b30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:35.517596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44f098-43f2-4199-a92e-4c173c019b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:35.518989 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44f098-43f2-4199-a92e-4c173c019b30 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d6537cd4-56f6-4d3e-9d89-9f9a4f5dd9bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:35.523878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:35.524735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:35.526359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:35.526359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:35.526359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:35.526359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:35.526359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 413/846] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:35.526739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0503cc-ce5c-4f3e-bfbb-dd6bb375fef9 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.526933 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0503cc-ce5c-4f3e-bfbb-dd6bb375fef9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.527211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0503cc-ce5c-4f3e-bfbb-dd6bb375fef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.532102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 434/847] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:35.533290 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44f098-43f2-4199-a92e-4c173c019b30 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:35.539423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:35.548680 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-fc0503cc-ce5c-4f3e-bfbb-dd6bb375fef9 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:35.550018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fc0503cc-ce5c-4f3e-bfbb-dd6bb375fef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:35.619635 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 414/848] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:35.626078 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0503cc-ce5c-4f3e-bfbb-dd6bb375fef9 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:35.646655 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44f098-43f2-4199-a92e-4c173c019b30 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:35.647899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:35.685348 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d94882-f9bf-43d3-8ad6-3260475f7f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:35.686021 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d94882-f9bf-43d3-8ad6-3260475f7f35 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.686309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d94882-f9bf-43d3-8ad6-3260475f7f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.686590 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d94882-f9bf-43d3-8ad6-3260475f7f35 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.687310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d94882-f9bf-43d3-8ad6-3260475f7f35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:35.687619 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d94882-f9bf-43d3-8ad6-3260475f7f35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:35.689025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d94882-f9bf-43d3-8ad6-3260475f7f35 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:35.701192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 435/849] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:35.701980 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d94882-f9bf-43d3-8ad6-3260475f7f35 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:35.752751 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0503cc-ce5c-4f3e-bfbb-dd6bb375fef9 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:35.770506 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:35.792863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d9ff4-819e-46db-9939-6c606b8c62ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:35.793632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9ff4-819e-46db-9939-6c606b8c62ce None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.793912 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9ff4-819e-46db-9939-6c606b8c62ce None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.794185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9ff4-819e-46db-9939-6c606b8c62ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.805953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d9ff4-819e-46db-9939-6c606b8c62ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:35.807388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d9ff4-819e-46db-9939-6c606b8c62ce None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:35.813046 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d94882-f9bf-43d3-8ad6-3260475f7f35 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e45d9ff4-819e-46db-9939-6c606b8c62ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:35.825153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:35.826220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:35.827094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:35.827094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:35.827094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:35.827094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:35.827094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 415/850] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:35.827094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d9ff4-819e-46db-9939-6c606b8c62ce None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:35.855663 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c71a5-ef2b-40ee-a001-5dc20daec233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:35.856776 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c71a5-ef2b-40ee-a001-5dc20daec233 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.857258 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c71a5-ef2b-40ee-a001-5dc20daec233 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.857684 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c71a5-ef2b-40ee-a001-5dc20daec233 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.858623 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c71a5-ef2b-40ee-a001-5dc20daec233 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:35.860207 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c71a5-ef2b-40ee-a001-5dc20daec233 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-5b1c71a5-ef2b-40ee-a001-5dc20daec233 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:35.873352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:35.874580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 10:02:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:35.878005 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 436/851] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:02:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:35.879567 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c71a5-ef2b-40ee-a001-5dc20daec233 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:35.899809 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:35.935302 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d9ff4-819e-46db-9939-6c606b8c62ce None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:35.975300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe52125-5ea9-4afe-a7f9-a0b266964ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:35.976103 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe52125-5ea9-4afe-a7f9-a0b266964ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:35.976390 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe52125-5ea9-4afe-a7f9-a0b266964ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:35.976674 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe52125-5ea9-4afe-a7f9-a0b266964ac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:35.983697 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe52125-5ea9-4afe-a7f9-a0b266964ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:35.985172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe52125-5ea9-4afe-a7f9-a0b266964ac0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-ffe52125-5ea9-4afe-a7f9-a0b266964ac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:35.999456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:36.001044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:36.002522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:36.002522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:36.002522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:36.002522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:36.002522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:36.002522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:36.002522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:36.002522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:36.002522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 416/852] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:36.002522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe52125-5ea9-4afe-a7f9-a0b266964ac0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:36.009566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c71a5-ef2b-40ee-a001-5dc20daec233 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:36.043125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:36.053503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5821b3-8783-4c36-ae60-c02b138ee153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:36.054184 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5821b3-8783-4c36-ae60-c02b138ee153 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:36.054471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5821b3-8783-4c36-ae60-c02b138ee153 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:36.054751 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5821b3-8783-4c36-ae60-c02b138ee153 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:36.055976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5821b3-8783-4c36-ae60-c02b138ee153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:36.055976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5821b3-8783-4c36-ae60-c02b138ee153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:36.057212 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5821b3-8783-4c36-ae60-c02b138ee153 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:36.075624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 437/853] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:36.075624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5821b3-8783-4c36-ae60-c02b138ee153 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:36.118264 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe52125-5ea9-4afe-a7f9-a0b266964ac0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:36.146549 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:36.156538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfbf84-5be6-4fd8-9596-bd111f0d7d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:36.157237 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfbf84-5be6-4fd8-9596-bd111f0d7d6d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:36.157532 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfbf84-5be6-4fd8-9596-bd111f0d7d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:36.157814 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfbf84-5be6-4fd8-9596-bd111f0d7d6d None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:36.158523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfbf84-5be6-4fd8-9596-bd111f0d7d6d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:36.158835 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfbf84-5be6-4fd8-9596-bd111f0d7d6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:36.160234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfbf84-5be6-4fd8-9596-bd111f0d7d6d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:36.169327 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 417/854] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:02:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:36.169327 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfbf84-5be6-4fd8-9596-bd111f0d7d6d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:36.182282 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5821b3-8783-4c36-ae60-c02b138ee153 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:36.219450 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f694450-d44f-4e6e-80e0-f211f6e39fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:36.220230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f694450-d44f-4e6e-80e0-f211f6e39fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:36.220518 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f694450-d44f-4e6e-80e0-f211f6e39fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:36.220798 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f694450-d44f-4e6e-80e0-f211f6e39fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:36.221640 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f694450-d44f-4e6e-80e0-f211f6e39fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:36.221996 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f694450-d44f-4e6e-80e0-f211f6e39fc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:36.223547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f694450-d44f-4e6e-80e0-f211f6e39fc6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:36.240842 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 438/855] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:36.240842 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f694450-d44f-4e6e-80e0-f211f6e39fc6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:36.276250 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfbf84-5be6-4fd8-9596-bd111f0d7d6d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:36.291539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:36.317383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f020d72-7c78-449e-81dc-ddfb73621d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:36.318515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f020d72-7c78-449e-81dc-ddfb73621d6c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:36.318934 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f020d72-7c78-449e-81dc-ddfb73621d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:36.319311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f020d72-7c78-449e-81dc-ddfb73621d6c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:36.328083 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f020d72-7c78-449e-81dc-ddfb73621d6c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:36.329563 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f020d72-7c78-449e-81dc-ddfb73621d6c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-3f020d72-7c78-449e-81dc-ddfb73621d6c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:36.343909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:36.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 418/856] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:02:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:36.348049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f020d72-7c78-449e-81dc-ddfb73621d6c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:36.357372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f694450-d44f-4e6e-80e0-f211f6e39fc6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:36.391864 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19a4aa-ad7a-44a2-b8cd-3c9d395e2b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:36.392804 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19a4aa-ad7a-44a2-b8cd-3c9d395e2b40 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:36.393116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19a4aa-ad7a-44a2-b8cd-3c9d395e2b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:36.393394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19a4aa-ad7a-44a2-b8cd-3c9d395e2b40 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:36.394092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19a4aa-ad7a-44a2-b8cd-3c9d395e2b40 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:36.394395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19a4aa-ad7a-44a2-b8cd-3c9d395e2b40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:36.395761 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19a4aa-ad7a-44a2-b8cd-3c9d395e2b40 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:36.400160 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 439/857] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:02:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:36.400960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19a4aa-ad7a-44a2-b8cd-3c9d395e2b40 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:36.402502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:36.463198 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f020d72-7c78-449e-81dc-ddfb73621d6c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:36.499842 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c491a81-0860-4618-b75f-d50b7092c0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:36.500607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c491a81-0860-4618-b75f-d50b7092c0fd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:36.500787 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c491a81-0860-4618-b75f-d50b7092c0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:36.501092 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c491a81-0860-4618-b75f-d50b7092c0fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:36.501937 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c491a81-0860-4618-b75f-d50b7092c0fd None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=f2683e79ea804a7987642df32f03fad5) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:36.502249 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c491a81-0860-4618-b75f-d50b7092c0fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:36.503712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c491a81-0860-4618-b75f-d50b7092c0fd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:36.510362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 419/858] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:36 2022] GET /identity/v3/role_assignments?user.id=f2683e79ea804a7987642df32f03fad5&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:36.511718 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871ced-8a6b-4ba9-aa6e-044a6dba624e None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:36.512005 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871ced-8a6b-4ba9-aa6e-044a6dba624e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:36.512280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871ced-8a6b-4ba9-aa6e-044a6dba624e None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:36.513797 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 420/859] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:36.520117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac08c8-f8e4-43ba-a574-31759882fde9 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:36.520325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac08c8-f8e4-43ba-a574-31759882fde9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:36.520538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac08c8-f8e4-43ba-a574-31759882fde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:36.540874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-c5ac08c8-f8e4-43ba-a574-31759882fde9 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:36.542350 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c5ac08c8-f8e4-43ba-a574-31759882fde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:36.553722 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19a4aa-ad7a-44a2-b8cd-3c9d395e2b40 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:36.573489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:36.599894 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5769915-2937-480d-b180-256d6ace0302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:36.600883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5769915-2937-480d-b180-256d6ace0302 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:36.601366 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5769915-2937-480d-b180-256d6ace0302 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:36.601793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5769915-2937-480d-b180-256d6ace0302 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:36.602806 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5769915-2937-480d-b180-256d6ace0302 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:36.603273 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5769915-2937-480d-b180-256d6ace0302 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:36.604999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5769915-2937-480d-b180-256d6ace0302 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:36.626844 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 440/860] 10.222.0.13 () {56 vars in 1135 bytes} [Tue Jul 5 10:02:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:36.633342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5769915-2937-480d-b180-256d6ace0302 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:36.640627 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 421/861] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:36.668919 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac08c8-f8e4-43ba-a574-31759882fde9 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:36.733255 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:36.763748 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5769915-2937-480d-b180-256d6ace0302 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:36.800856 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac08c8-f8e4-43ba-a574-31759882fde9 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:36.801183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb6a79-daf8-497c-b76a-fc6e71a01f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:36.801856 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6a79-daf8-497c-b76a-fc6e71a01f09 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:36.802146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6a79-daf8-497c-b76a-fc6e71a01f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:36.802528 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6a79-daf8-497c-b76a-fc6e71a01f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:36.839561 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf146e-8db7-4a9d-9c26-1a19eaba75a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:36.840572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf146e-8db7-4a9d-9c26-1a19eaba75a6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:36.840861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf146e-8db7-4a9d-9c26-1a19eaba75a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:36.841181 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf146e-8db7-4a9d-9c26-1a19eaba75a6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:36.841841 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf146e-8db7-4a9d-9c26-1a19eaba75a6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:36.844162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf146e-8db7-4a9d-9c26-1a19eaba75a6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:36.849110 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-2bcf146e-8db7-4a9d-9c26-1a19eaba75a6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:36.860106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:36.861126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:36.861944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 422/862] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Jul 5 10:02:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:36.868325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf146e-8db7-4a9d-9c26-1a19eaba75a6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:36.885173 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb6a79-daf8-497c-b76a-fc6e71a01f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:36.887070 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb6a79-daf8-497c-b76a-fc6e71a01f09 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:36.992049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf146e-8db7-4a9d-9c26-1a19eaba75a6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:37.005247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:37.005613 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 441/863] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:36 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 10:02:37.006714 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb6a79-daf8-497c-b76a-fc6e71a01f09 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:37.041875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91d642-5b03-4158-8dc2-eaca5cc7c2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:37.042818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91d642-5b03-4158-8dc2-eaca5cc7c2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:37.043502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91d642-5b03-4158-8dc2-eaca5cc7c2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:37.043791 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91d642-5b03-4158-8dc2-eaca5cc7c2d9 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:37.045074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91d642-5b03-4158-8dc2-eaca5cc7c2d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:37.045390 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91d642-5b03-4158-8dc2-eaca5cc7c2d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:37.047057 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91d642-5b03-4158-8dc2-eaca5cc7c2d9 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:37.053544 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 423/864] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 10:02:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:37.058175 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91d642-5b03-4158-8dc2-eaca5cc7c2d9 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:37.090907 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:37.129120 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb6a79-daf8-497c-b76a-fc6e71a01f09 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:37.165710 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60186a89-f25a-4cdd-872e-d8d94e52afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:37.166520 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186a89-f25a-4cdd-872e-d8d94e52afa9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:37.166796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186a89-f25a-4cdd-872e-d8d94e52afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:37.167297 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186a89-f25a-4cdd-872e-d8d94e52afa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:37.178602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60186a89-f25a-4cdd-872e-d8d94e52afa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:37.180140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60186a89-f25a-4cdd-872e-d8d94e52afa9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:37.195044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91d642-5b03-4158-8dc2-eaca5cc7c2d9 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-60186a89-f25a-4cdd-872e-d8d94e52afa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:37.198489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:37.199342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:37.200417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:37.200417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:37.200417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:37.200417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:37.200417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 442/865] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:37.209875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60186a89-f25a-4cdd-872e-d8d94e52afa9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:37.238914 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503cb02-6eca-4d04-844c-7173155944f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:37.240440 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503cb02-6eca-4d04-844c-7173155944f1 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:37.240874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503cb02-6eca-4d04-844c-7173155944f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:37.241560 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503cb02-6eca-4d04-844c-7173155944f1 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:37.242687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503cb02-6eca-4d04-844c-7173155944f1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:37.243170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503cb02-6eca-4d04-844c-7173155944f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:37.245305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503cb02-6eca-4d04-844c-7173155944f1 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:37.251358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 424/866] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 10:02:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:37.331635 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60186a89-f25a-4cdd-872e-d8d94e52afa9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:37.358671 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:37.372584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf52cca-2023-46ca-ae90-ac55f625c023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:37.373341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf52cca-2023-46ca-ae90-ac55f625c023 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:37.373632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf52cca-2023-46ca-ae90-ac55f625c023 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:37.373916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf52cca-2023-46ca-ae90-ac55f625c023 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:37.374651 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf52cca-2023-46ca-ae90-ac55f625c023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:37.374958 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf52cca-2023-46ca-ae90-ac55f625c023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:37.376368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf52cca-2023-46ca-ae90-ac55f625c023 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:37.390545 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 443/867] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:37.395893 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503cb02-6eca-4d04-844c-7173155944f1 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:37.433436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:37.502536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503cb02-6eca-4d04-844c-7173155944f1 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:37.538064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc2cbe-b176-4d8c-bbd3-356c1cce2f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:37.538861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2cbe-b176-4d8c-bbd3-356c1cce2f01 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:37.539144 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2cbe-b176-4d8c-bbd3-356c1cce2f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:37.539422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2cbe-b176-4d8c-bbd3-356c1cce2f01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:37.546574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc2cbe-b176-4d8c-bbd3-356c1cce2f01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:37.548025 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc2cbe-b176-4d8c-bbd3-356c1cce2f01 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-55bc2cbe-b176-4d8c-bbd3-356c1cce2f01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:37.563265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:37.564158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:37.565059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:37.565059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:37.565059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:37.565059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:37.565059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:37.565059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:37.565059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:37.565059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:37.565059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 425/868] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:37.572247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf52cca-2023-46ca-ae90-ac55f625c023 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:37.802931 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf52cca-2023-46ca-ae90-ac55f625c023 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:37.837815 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f9c01-0e88-4257-9145-b6c4b2b3ffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:37.838477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9c01-0e88-4257-9145-b6c4b2b3ffa3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:37.838757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9c01-0e88-4257-9145-b6c4b2b3ffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:37.839031 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9c01-0e88-4257-9145-b6c4b2b3ffa3 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:37.839806 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f9c01-0e88-4257-9145-b6c4b2b3ffa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:37.840110 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f9c01-0e88-4257-9145-b6c4b2b3ffa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:37.841571 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f9c01-0e88-4257-9145-b6c4b2b3ffa3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:37.853527 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 444/869] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:37.859074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc2cbe-b176-4d8c-bbd3-356c1cce2f01 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:37.956573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:37.963117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc2cbe-b176-4d8c-bbd3-356c1cce2f01 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:37.998854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004cc02-dd93-47af-a1f5-3901a9d0fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:37.999513 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004cc02-dd93-47af-a1f5-3901a9d0fe52 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:37.999796 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004cc02-dd93-47af-a1f5-3901a9d0fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:38.000076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004cc02-dd93-47af-a1f5-3901a9d0fe52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:38.000918 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004cc02-dd93-47af-a1f5-3901a9d0fe52 None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=1167f58a1ea3465083d67a94043066be) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:38.001252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004cc02-dd93-47af-a1f5-3901a9d0fe52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:38.002677 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004cc02-dd93-47af-a1f5-3901a9d0fe52 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:38.009616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 426/870] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:37 2022] GET /identity/v3/role_assignments?user.id=1167f58a1ea3465083d67a94043066be&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:38.547674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca5ea-455b-4902-8d76-2508059adf4b None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:38.547872 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca5ea-455b-4902-8d76-2508059adf4b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:38.548136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca5ea-455b-4902-8d76-2508059adf4b None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:38.550658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 445/871] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:38.555965 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a6120-8865-490a-9f1a-e527b911502c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:38.556804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a6120-8865-490a-9f1a-e527b911502c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:38.557322 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a6120-8865-490a-9f1a-e527b911502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:38.574296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5b7a6120-8865-490a-9f1a-e527b911502c None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:38.575739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5b7a6120-8865-490a-9f1a-e527b911502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:38.644128 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 427/872] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:38.667147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca5ea-455b-4902-8d76-2508059adf4b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:38.713695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:38.773984 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca5ea-455b-4902-8d76-2508059adf4b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:38.808538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09abcc-521c-468f-b259-f9d51060b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:38.809162 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09abcc-521c-468f-b259-f9d51060b1b0 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:38.809443 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09abcc-521c-468f-b259-f9d51060b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:38.809717 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09abcc-521c-468f-b259-f9d51060b1b0 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:38.810437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09abcc-521c-468f-b259-f9d51060b1b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:38.811906 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09abcc-521c-468f-b259-f9d51060b1b0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:38.820333 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055751e4-37b1-4021-b1a3-a93e4a642d99 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:38.820661 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055751e4-37b1-4021-b1a3-a93e4a642d99 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:38.820918 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055751e4-37b1-4021-b1a3-a93e4a642d99 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:38.823484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 428/873] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:38.827625 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a75087-ed11-410c-83b5-4f1d558115c1 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:38.827869 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a75087-ed11-410c-83b5-4f1d558115c1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:38.828151 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a75087-ed11-410c-83b5-4f1d558115c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:38.830109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 446/874] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:02:38 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:38.850743 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-91a75087-ed11-410c-83b5-4f1d558115c1 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:38.852076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-91a75087-ed11-410c-83b5-4f1d558115c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:38.944882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 429/875] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:38.968406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09abcc-521c-468f-b259-f9d51060b1b0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:39.077883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09abcc-521c-468f-b259-f9d51060b1b0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:39.079360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:39.115858 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dcec4-e61f-48be-b003-47b3bcc52aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:39.116677 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dcec4-e61f-48be-b003-47b3bcc52aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:39.116995 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dcec4-e61f-48be-b003-47b3bcc52aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:39.117267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dcec4-e61f-48be-b003-47b3bcc52aa2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:39.127968 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dcec4-e61f-48be-b003-47b3bcc52aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-cf3dcec4-e61f-48be-b003-47b3bcc52aa2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:39.136845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:39.137955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:39.139066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 447/876] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 10:02:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:39.146381 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a75087-ed11-410c-83b5-4f1d558115c1 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:39.165933 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:39.257670 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a75087-ed11-410c-83b5-4f1d558115c1 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:39.293629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81713ff-bd6d-4ae4-882a-4344e7e87bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:39.294300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81713ff-bd6d-4ae4-882a-4344e7e87bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:39.294836 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81713ff-bd6d-4ae4-882a-4344e7e87bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:39.295107 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81713ff-bd6d-4ae4-882a-4344e7e87bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:39.295853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81713ff-bd6d-4ae4-882a-4344e7e87bf8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:39.296159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81713ff-bd6d-4ae4-882a-4344e7e87bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:39.297608 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81713ff-bd6d-4ae4-882a-4344e7e87bf8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:39.306569 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 430/877] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 10:02:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:39.312093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dcec4-e61f-48be-b003-47b3bcc52aa2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:39.379234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ad3e6-60e5-4c7c-b83a-b368dc5d6032 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:39.379234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ad3e6-60e5-4c7c-b83a-b368dc5d6032 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:39.379623 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ad3e6-60e5-4c7c-b83a-b368dc5d6032 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:39.381117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 431/878] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:02:39.388747 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f58d-f9bf-4a3e-ab47-21b2f68b3555 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:39.388747 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f58d-f9bf-4a3e-ab47-21b2f68b3555 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:39.388990 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f58d-f9bf-4a3e-ab47-21b2f68b3555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:39.406383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-7604f58d-f9bf-4a3e-ab47-21b2f68b3555 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:39.407922 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7604f58d-f9bf-4a3e-ab47-21b2f68b3555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:39.420987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dcec4-e61f-48be-b003-47b3bcc52aa2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:39.455785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68f947-2b94-4a55-8f76-328b05e57bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:39.457744 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68f947-2b94-4a55-8f76-328b05e57bcf None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:39.458475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68f947-2b94-4a55-8f76-328b05e57bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:39.458905 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68f947-2b94-4a55-8f76-328b05e57bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:39.473106 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68f947-2b94-4a55-8f76-328b05e57bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:39.475377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68f947-2b94-4a55-8f76-328b05e57bcf None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:39.489256 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 432/879] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:39 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4b68f947-2b94-4a55-8f76-328b05e57bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:39.494310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:39.495235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:39.496111 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:39.496111 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:39.496111 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:39.496111 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:39.502543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 448/880] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:39.504040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f58d-f9bf-4a3e-ab47-21b2f68b3555 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:39.507697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68f947-2b94-4a55-8f76-328b05e57bcf None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:39.517235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:39.527657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:39.620023 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68f947-2b94-4a55-8f76-328b05e57bcf None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:39.629649 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f58d-f9bf-4a3e-ab47-21b2f68b3555 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:39.666943 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3821c8-13cc-4bc0-8dee-f988b8046d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:39.667176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23698a-bd23-420f-903d-9cc7d406095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:39.667746 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23698a-bd23-420f-903d-9cc7d406095e None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:39.667914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23698a-bd23-420f-903d-9cc7d406095e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:39.668171 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23698a-bd23-420f-903d-9cc7d406095e None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:39.668931 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23698a-bd23-420f-903d-9cc7d406095e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:39.669245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3821c8-13cc-4bc0-8dee-f988b8046d8f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:39.669964 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3821c8-13cc-4bc0-8dee-f988b8046d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:39.670441 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3821c8-13cc-4bc0-8dee-f988b8046d8f None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:39.670542 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23698a-bd23-420f-903d-9cc7d406095e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:39.671479 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3821c8-13cc-4bc0-8dee-f988b8046d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:39.671998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3821c8-13cc-4bc0-8dee-f988b8046d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:39.673810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3821c8-13cc-4bc0-8dee-f988b8046d8f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:39.689704 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 433/882] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:39.696929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3821c8-13cc-4bc0-8dee-f988b8046d8f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:39.697283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 449/882] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:02:39 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:39.774889 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:39.819613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3821c8-13cc-4bc0-8dee-f988b8046d8f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:39.860763 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be95580-df0c-4104-b218-21bc4170cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:39.861612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be95580-df0c-4104-b218-21bc4170cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:39.861894 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be95580-df0c-4104-b218-21bc4170cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:39.862169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be95580-df0c-4104-b218-21bc4170cfa7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:39.870985 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be95580-df0c-4104-b218-21bc4170cfa7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:39.872428 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be95580-df0c-4104-b218-21bc4170cfa7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1be95580-df0c-4104-b218-21bc4170cfa7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:39.887391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:39.888509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:39.889668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:39.889668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:39.889668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:39.889668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:39.889668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:39.889668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:39.889668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:39.889668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:39.889668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:39.889668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:39.893025 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 434/883] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 10:02:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:39.894601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23698a-bd23-420f-903d-9cc7d406095e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:39.976914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:40.004213 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23698a-bd23-420f-903d-9cc7d406095e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:40.042265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606dc92-3df5-47ef-9ae0-8d423ef91c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:40.042949 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606dc92-3df5-47ef-9ae0-8d423ef91c66 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:40.043231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606dc92-3df5-47ef-9ae0-8d423ef91c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:40.043510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606dc92-3df5-47ef-9ae0-8d423ef91c66 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:40.044348 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606dc92-3df5-47ef-9ae0-8d423ef91c66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:40.044932 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606dc92-3df5-47ef-9ae0-8d423ef91c66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:40.046369 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606dc92-3df5-47ef-9ae0-8d423ef91c66 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:40.069035 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 450/884] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 10:02:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:40.071395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be95580-df0c-4104-b218-21bc4170cfa7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:40.137035 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836851a-5179-4142-9193-e9b2b8ba9040 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:40.137369 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836851a-5179-4142-9193-e9b2b8ba9040 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:40.137656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836851a-5179-4142-9193-e9b2b8ba9040 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:40.139225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 451/885] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:40.144481 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4059-1892-40fa-a8ca-7580048935e5 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:40.144769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4059-1892-40fa-a8ca-7580048935e5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:40.145078 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4059-1892-40fa-a8ca-7580048935e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:40.161385 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1f6a4059-1892-40fa-a8ca-7580048935e5 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:40.162588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1f6a4059-1892-40fa-a8ca-7580048935e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:40.193726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be95580-df0c-4104-b218-21bc4170cfa7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:40.222851 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:40.232966 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 452/886] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:40.241083 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e03fe8-afda-4c63-86f5-6a89e379d238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:40.241899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e03fe8-afda-4c63-86f5-6a89e379d238 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:40.242359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e03fe8-afda-4c63-86f5-6a89e379d238 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:40.242818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e03fe8-afda-4c63-86f5-6a89e379d238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:40.255144 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a4059-1892-40fa-a8ca-7580048935e5 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:40.326597 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e03fe8-afda-4c63-86f5-6a89e379d238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:40.328829 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e03fe8-afda-4c63-86f5-6a89e379d238 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:40.329119 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:40.373104 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a4059-1892-40fa-a8ca-7580048935e5 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:40.421421 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e820dc3-76e1-4899-a87f-9149dd26f33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:40.422172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820dc3-76e1-4899-a87f-9149dd26f33a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:40.422453 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820dc3-76e1-4899-a87f-9149dd26f33a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:40.422726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e820dc3-76e1-4899-a87f-9149dd26f33a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:40.423498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e820dc3-76e1-4899-a87f-9149dd26f33a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:40.425600 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e820dc3-76e1-4899-a87f-9149dd26f33a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-7e820dc3-76e1-4899-a87f-9149dd26f33a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:40.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:40.441758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:40.442987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 453/887] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 10:02:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:40.447413 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e820dc3-76e1-4899-a87f-9149dd26f33a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:40.463488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 435/888] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:40 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:02:40.464751 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e03fe8-afda-4c63-86f5-6a89e379d238 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:40.490822 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:40.583658 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e03fe8-afda-4c63-86f5-6a89e379d238 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:40.587837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e820dc3-76e1-4899-a87f-9149dd26f33a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:40.620018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ef9a7-7536-4c06-af76-2d97920bcc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:40.620878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef9a7-7536-4c06-af76-2d97920bcc0a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:40.621109 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef9a7-7536-4c06-af76-2d97920bcc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:40.621411 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef9a7-7536-4c06-af76-2d97920bcc0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:40.622899 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:40.632015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ef9a7-7536-4c06-af76-2d97920bcc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:40.633489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ef9a7-7536-4c06-af76-2d97920bcc0a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:40.636512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd280d3a-92ac-45a2-986a-da55d6e365b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:40.637455 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280d3a-92ac-45a2-986a-da55d6e365b7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:40.637936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280d3a-92ac-45a2-986a-da55d6e365b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:40.638405 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280d3a-92ac-45a2-986a-da55d6e365b7 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:40.639313 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd280d3a-92ac-45a2-986a-da55d6e365b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:40.639814 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd280d3a-92ac-45a2-986a-da55d6e365b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:40.642363 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd280d3a-92ac-45a2-986a-da55d6e365b7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-8a6ef9a7-7536-4c06-af76-2d97920bcc0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:40.652305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:40.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:40.654126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:40.654126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:40.654126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:40.654126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:40.655089 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 454/890] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 10:02:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:40.656141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd280d3a-92ac-45a2-986a-da55d6e365b7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:40.657748 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 436/890] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:40.658858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ef9a7-7536-4c06-af76-2d97920bcc0a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:40.762562 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:40.766351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd280d3a-92ac-45a2-986a-da55d6e365b7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:40.799813 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ef9a7-7536-4c06-af76-2d97920bcc0a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:40.802843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7bcae-b272-4fb2-a5be-bec96cab4697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:40.804047 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7bcae-b272-4fb2-a5be-bec96cab4697 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:40.804047 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7bcae-b272-4fb2-a5be-bec96cab4697 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:40.804246 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7bcae-b272-4fb2-a5be-bec96cab4697 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:40.804860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7bcae-b272-4fb2-a5be-bec96cab4697 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:40.805201 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7bcae-b272-4fb2-a5be-bec96cab4697 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:40.806579 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7bcae-b272-4fb2-a5be-bec96cab4697 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:40.816925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 455/891] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 10:02:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:40.845367 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7833c-5d51-4dfc-ab3f-a836a272de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:40.846052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7833c-5d51-4dfc-ab3f-a836a272de6b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:40.846336 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7833c-5d51-4dfc-ab3f-a836a272de6b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:40.846612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7833c-5d51-4dfc-ab3f-a836a272de6b None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:40.847888 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7833c-5d51-4dfc-ab3f-a836a272de6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:40.848201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7833c-5d51-4dfc-ab3f-a836a272de6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:40.849659 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7833c-5d51-4dfc-ab3f-a836a272de6b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:40.868109 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 437/892] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:40.870069 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7bcae-b272-4fb2-a5be-bec96cab4697 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:40.934607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:40.983582 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7bcae-b272-4fb2-a5be-bec96cab4697 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:41.022535 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b8b59-5c03-42c4-8012-ff726c5a6af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:41.023268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b8b59-5c03-42c4-8012-ff726c5a6af6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:41.023615 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b8b59-5c03-42c4-8012-ff726c5a6af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:41.023894 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b8b59-5c03-42c4-8012-ff726c5a6af6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:41.028871 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469c332-824f-4938-8ac9-d13ba957ebe1 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:41.029188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469c332-824f-4938-8ac9-d13ba957ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:41.029468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469c332-824f-4938-8ac9-d13ba957ebe1 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:41.030827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 438/893] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:02:41.033071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b8b59-5c03-42c4-8012-ff726c5a6af6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:41.035299 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b8b59-5c03-42c4-8012-ff726c5a6af6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:41.037550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ceb04-8e1c-48c3-b9ae-1ec2544c8184 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:41.037550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ceb04-8e1c-48c3-b9ae-1ec2544c8184 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:41.037550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ceb04-8e1c-48c3-b9ae-1ec2544c8184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:41.056043 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-7a9ceb04-8e1c-48c3-b9ae-1ec2544c8184 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-486b8b59-5c03-42c4-8012-ff726c5a6af6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:41.056786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:41.057857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:41.058951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:41.058951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:41.058951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:41.058951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:41.058951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:41.058951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:41.058951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:41.058951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:41.059428 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7a9ceb04-8e1c-48c3-b9ae-1ec2544c8184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:41.062334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 456/894] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:41.070099 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b8b59-5c03-42c4-8012-ff726c5a6af6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:41.145963 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 439/895] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:41.168471 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ceb04-8e1c-48c3-b9ae-1ec2544c8184 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:41.188115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b8b59-5c03-42c4-8012-ff726c5a6af6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:41.207626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:41.234433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5524db0-8e51-42ae-8a8f-0d559cc7d370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:41.235797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5524db0-8e51-42ae-8a8f-0d559cc7d370 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:41.236274 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5524db0-8e51-42ae-8a8f-0d559cc7d370 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:41.237020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5524db0-8e51-42ae-8a8f-0d559cc7d370 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:41.238063 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5524db0-8e51-42ae-8a8f-0d559cc7d370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:41.238556 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5524db0-8e51-42ae-8a8f-0d559cc7d370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:41.239454 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:41.240536 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5524db0-8e51-42ae-8a8f-0d559cc7d370 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:41.260526 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 457/896] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:41.262472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5524db0-8e51-42ae-8a8f-0d559cc7d370 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:41.283965 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ceb04-8e1c-48c3-b9ae-1ec2544c8184 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:41.326938 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aea5e6-eae7-4266-8a3e-5d48946e63d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:41.328007 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aea5e6-eae7-4266-8a3e-5d48946e63d3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:41.328543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aea5e6-eae7-4266-8a3e-5d48946e63d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:41.329103 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aea5e6-eae7-4266-8a3e-5d48946e63d3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:41.329944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aea5e6-eae7-4266-8a3e-5d48946e63d3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:41.332056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aea5e6-eae7-4266-8a3e-5d48946e63d3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d4aea5e6-eae7-4266-8a3e-5d48946e63d3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:41.345419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:41.346437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 10:02:41.347301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:41.355244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 440/897] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:02:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:41.356447 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aea5e6-eae7-4266-8a3e-5d48946e63d3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:41.383636 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5524db0-8e51-42ae-8a8f-0d559cc7d370 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:41.418909 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5bd11-1595-4f14-b64e-00d5a3315d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:41.420011 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5bd11-1595-4f14-b64e-00d5a3315d98 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:41.420445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5bd11-1595-4f14-b64e-00d5a3315d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:41.420793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5bd11-1595-4f14-b64e-00d5a3315d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:41.421716 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5bd11-1595-4f14-b64e-00d5a3315d98 None admin] RBAC: Adding query filter params (role.id=008ab9f39a224eb08f13bc0c9c574e1c, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=f2683e79ea804a7987642df32f03fad5) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:41.422100 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5bd11-1595-4f14-b64e-00d5a3315d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:41.423693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5bd11-1595-4f14-b64e-00d5a3315d98 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:41.437055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 458/898] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:41 2022] GET /identity/v3/role_assignments?user.id=f2683e79ea804a7987642df32f03fad5&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=008ab9f39a224eb08f13bc0c9c574e1c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:41.466090 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aea5e6-eae7-4266-8a3e-5d48946e63d3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:41.504349 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:41.510856 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642c15b-3483-4c88-b064-32173f25e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:41.511665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642c15b-3483-4c88-b064-32173f25e1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:41.512151 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642c15b-3483-4c88-b064-32173f25e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:41.512426 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642c15b-3483-4c88-b064-32173f25e1a3 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:41.513174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642c15b-3483-4c88-b064-32173f25e1a3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:41.513479 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642c15b-3483-4c88-b064-32173f25e1a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:41.514887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642c15b-3483-4c88-b064-32173f25e1a3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:41.521369 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 441/899] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:02:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:41.527300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5bd11-1595-4f14-b64e-00d5a3315d98 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:41.571926 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:41.639464 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5bd11-1595-4f14-b64e-00d5a3315d98 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:41.674845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccbd97-a629-4aff-a8a8-191832c706af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:41.676476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccbd97-a629-4aff-a8a8-191832c706af None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:41.676999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccbd97-a629-4aff-a8a8-191832c706af None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:41.677496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccbd97-a629-4aff-a8a8-191832c706af None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:41.678430 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccbd97-a629-4aff-a8a8-191832c706af None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:41.678949 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccbd97-a629-4aff-a8a8-191832c706af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:41.680559 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccbd97-a629-4aff-a8a8-191832c706af None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:41.686076 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 459/900] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:02:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:41.692610 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642c15b-3483-4c88-b064-32173f25e1a3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:41.803125 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642c15b-3483-4c88-b064-32173f25e1a3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:41.837943 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b04915-3c18-4b18-90a8-e03b042ec3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:41.838515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b04915-3c18-4b18-90a8-e03b042ec3bd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:41.838795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b04915-3c18-4b18-90a8-e03b042ec3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:41.839069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b04915-3c18-4b18-90a8-e03b042ec3bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:41.839844 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b04915-3c18-4b18-90a8-e03b042ec3bd None admin] RBAC: Adding query filter params (interface=public, service_id=dcbcab26dd6d4ac5a5a5740c0fbc21be, region_id=RegionOne) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:41.840154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b04915-3c18-4b18-90a8-e03b042ec3bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:41.841541 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b04915-3c18-4b18-90a8-e03b042ec3bd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:41.846783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 442/901] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 10:02:41 2022] GET /identity/v3/endpoints?service_id=dcbcab26dd6d4ac5a5a5740c0fbc21be&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:41.852112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccbd97-a629-4aff-a8a8-191832c706af None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:41.861214 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b55f8-ebbe-4719-bd66-0193bb08e47e None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:41.861503 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b55f8-ebbe-4719-bd66-0193bb08e47e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:41.861782 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b55f8-ebbe-4719-bd66-0193bb08e47e None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:41.863785 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 443/902] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:02:41.868457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a46e09-d1d3-4f4d-ba54-1eec5992aade None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:41.868745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a46e09-d1d3-4f4d-ba54-1eec5992aade None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:41.869066 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a46e09-d1d3-4f4d-ba54-1eec5992aade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:41.887825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d9a46e09-d1d3-4f4d-ba54-1eec5992aade None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:41.889359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d9a46e09-d1d3-4f4d-ba54-1eec5992aade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:41.953287 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:41.966945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 444/903] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:41.970244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccbd97-a629-4aff-a8a8-191832c706af None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:41.973284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:41.990698 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a46e09-d1d3-4f4d-ba54-1eec5992aade None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:42.009427 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1913f7-5607-4018-a284-07102bca72fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:42.010267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1913f7-5607-4018-a284-07102bca72fe None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:42.010554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1913f7-5607-4018-a284-07102bca72fe None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:42.010830 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1913f7-5607-4018-a284-07102bca72fe None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:42.011798 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1913f7-5607-4018-a284-07102bca72fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:42.013287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1913f7-5607-4018-a284-07102bca72fe None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:42.022034 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 460/904] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 10:02:41 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:02:42.110055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a46e09-d1d3-4f4d-ba54-1eec5992aade None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:42.148519 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95e6f5-aa21-40e3-97f4-1c7535ff9d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:42.149395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e6f5-aa21-40e3-97f4-1c7535ff9d5f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:42.149673 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e6f5-aa21-40e3-97f4-1c7535ff9d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:42.149942 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e6f5-aa21-40e3-97f4-1c7535ff9d5f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:42.150596 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95e6f5-aa21-40e3-97f4-1c7535ff9d5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:42.151968 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95e6f5-aa21-40e3-97f4-1c7535ff9d5f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-0f95e6f5-aa21-40e3-97f4-1c7535ff9d5f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:42.165311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:42.166296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:42.167136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 445/905] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Jul 5 10:02:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:42.173318 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1913f7-5607-4018-a284-07102bca72fe None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:42.278900 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1913f7-5607-4018-a284-07102bca72fe None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:42.318554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916408c3-1149-4c96-b175-a916603444d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:42.319223 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916408c3-1149-4c96-b175-a916603444d3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:42.319552 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916408c3-1149-4c96-b175-a916603444d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:42.319831 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916408c3-1149-4c96-b175-a916603444d3 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:42.320527 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916408c3-1149-4c96-b175-a916603444d3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:42.320824 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916408c3-1149-4c96-b175-a916603444d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:42.322207 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916408c3-1149-4c96-b175-a916603444d3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:42.327251 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 461/906] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 10:02:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:42.333325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95e6f5-aa21-40e3-97f4-1c7535ff9d5f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:42.393328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:42.436623 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95e6f5-aa21-40e3-97f4-1c7535ff9d5f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:42.470336 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2f813-cb40-4b88-9c2c-3a9c8ceda79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:42.470999 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2f813-cb40-4b88-9c2c-3a9c8ceda79b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:42.471281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2f813-cb40-4b88-9c2c-3a9c8ceda79b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:42.471556 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2f813-cb40-4b88-9c2c-3a9c8ceda79b None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:42.472886 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2f813-cb40-4b88-9c2c-3a9c8ceda79b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:42.473257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2f813-cb40-4b88-9c2c-3a9c8ceda79b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:42.474662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2f813-cb40-4b88-9c2c-3a9c8ceda79b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:42.479921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 446/907] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 10:02:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:42.485639 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916408c3-1149-4c96-b175-a916603444d3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:42.517966 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:42.588995 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916408c3-1149-4c96-b175-a916603444d3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:42.623145 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9eb0d0-5c57-4b78-9f51-a74ed0778388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:42.623855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eb0d0-5c57-4b78-9f51-a74ed0778388 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:42.624138 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eb0d0-5c57-4b78-9f51-a74ed0778388 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:42.624410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eb0d0-5c57-4b78-9f51-a74ed0778388 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:42.625222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9eb0d0-5c57-4b78-9f51-a74ed0778388 None admin] RBAC: Adding query filter params (interface=public, service_id=7ccd6506bc28414f9c4fdfc96fbb3efb, region_id=RegionOne) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:42.625534 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9eb0d0-5c57-4b78-9f51-a74ed0778388 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:42.627055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9eb0d0-5c57-4b78-9f51-a74ed0778388 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:42.633029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 462/908] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 10:02:42 2022] GET /identity/v3/endpoints?service_id=7ccd6506bc28414f9c4fdfc96fbb3efb&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:42.638268 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2f813-cb40-4b88-9c2c-3a9c8ceda79b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:42.742502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2f813-cb40-4b88-9c2c-3a9c8ceda79b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:42.760326 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:42.779083 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902377b-9ffe-4cc0-8c26-d2a96abd80c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:42.779751 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902377b-9ffe-4cc0-8c26-d2a96abd80c2 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:42.780032 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902377b-9ffe-4cc0-8c26-d2a96abd80c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:42.780307 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902377b-9ffe-4cc0-8c26-d2a96abd80c2 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:42.781011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902377b-9ffe-4cc0-8c26-d2a96abd80c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:42.782392 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902377b-9ffe-4cc0-8c26-d2a96abd80c2 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:42.788468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 447/909] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 10:02:42 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:02:43.017985 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c9f91-fc3e-4467-96fd-7de3c66a5bf2 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:43.019029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c9f91-fc3e-4467-96fd-7de3c66a5bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:43.019532 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c9f91-fc3e-4467-96fd-7de3c66a5bf2 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:43.021412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 463/910] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:43.026739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6128a-7625-454b-8518-62692618dd4f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:43.027260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6128a-7625-454b-8518-62692618dd4f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:43.027742 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6128a-7625-454b-8518-62692618dd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:43.045985 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-dcd6128a-7625-454b-8518-62692618dd4f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:43.047520 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-dcd6128a-7625-454b-8518-62692618dd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:43.120557 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 448/911] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:43.144322 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c9f91-fc3e-4467-96fd-7de3c66a5bf2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:43.250192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:43.258321 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c9f91-fc3e-4467-96fd-7de3c66a5bf2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:43.294361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4382c-4847-423f-b845-67ac39b625c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:43.294361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4382c-4847-423f-b845-67ac39b625c9 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:43.294361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4382c-4847-423f-b845-67ac39b625c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:43.294361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4382c-4847-423f-b845-67ac39b625c9 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:43.295118 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4382c-4847-423f-b845-67ac39b625c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:43.296492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4382c-4847-423f-b845-67ac39b625c9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:43.312384 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 464/912] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:02:43 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:43.595859 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dd172-2f38-4104-8768-a1bf062972b4 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:43.596104 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dd172-2f38-4104-8768-a1bf062972b4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:43.596562 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dd172-2f38-4104-8768-a1bf062972b4 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:43.599453 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 449/913] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:43.604858 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffcc07-e92e-49f1-8071-6d0096f875e2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:43.605272 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffcc07-e92e-49f1-8071-6d0096f875e2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:43.605632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffcc07-e92e-49f1-8071-6d0096f875e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:43.623463 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0bffcc07-e92e-49f1-8071-6d0096f875e2 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:43.624656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0bffcc07-e92e-49f1-8071-6d0096f875e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:43.704976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 465/914] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:43.723631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dd172-2f38-4104-8768-a1bf062972b4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:43.835054 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dd172-2f38-4104-8768-a1bf062972b4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:43.853350 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:43.871162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b39b25-9c7e-40f1-a604-be2baea006d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:43.871976 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b39b25-9c7e-40f1-a604-be2baea006d4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:43.872260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b39b25-9c7e-40f1-a604-be2baea006d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:43.872538 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b39b25-9c7e-40f1-a604-be2baea006d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:43.883500 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b39b25-9c7e-40f1-a604-be2baea006d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e0b39b25-9c7e-40f1-a604-be2baea006d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:43.891878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:43.892790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:02:43.893703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:43.897011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 450/915] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 10:02:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:43.899553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffcc07-e92e-49f1-8071-6d0096f875e2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:43.982486 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:44.002083 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffcc07-e92e-49f1-8071-6d0096f875e2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:44.039707 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf7923-84b8-4bc3-8270-09a2b0e18984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:44.040471 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf7923-84b8-4bc3-8270-09a2b0e18984 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:44.040676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf7923-84b8-4bc3-8270-09a2b0e18984 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:44.040984 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf7923-84b8-4bc3-8270-09a2b0e18984 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:44.041743 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf7923-84b8-4bc3-8270-09a2b0e18984 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:44.042056 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf7923-84b8-4bc3-8270-09a2b0e18984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:44.043449 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf7923-84b8-4bc3-8270-09a2b0e18984 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:44.057973 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 466/916] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 10:02:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:44.060181 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b39b25-9c7e-40f1-a604-be2baea006d4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:44.139865 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb8905-a8d8-4b53-8907-2d00eee65112 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:44.140834 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb8905-a8d8-4b53-8907-2d00eee65112 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:44.141675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb8905-a8d8-4b53-8907-2d00eee65112 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:44.148560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 467/917] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:44.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545723f7-82e9-4575-8359-6656edff2847 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:44.151274 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545723f7-82e9-4575-8359-6656edff2847 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:44.151986 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545723f7-82e9-4575-8359-6656edff2847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:44.168076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b39b25-9c7e-40f1-a604-be2baea006d4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:44.171644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-545723f7-82e9-4575-8359-6656edff2847 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:44.173086 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-545723f7-82e9-4575-8359-6656edff2847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:44.211804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9772-64bd-4c49-aa26-f83ba9b51998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:44.212599 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9772-64bd-4c49-aa26-f83ba9b51998 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:44.212885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9772-64bd-4c49-aa26-f83ba9b51998 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:44.213206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9772-64bd-4c49-aa26-f83ba9b51998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:44.226722 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9772-64bd-4c49-aa26-f83ba9b51998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:44.228396 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9772-64bd-4c49-aa26-f83ba9b51998 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1ada9772-64bd-4c49-aa26-f83ba9b51998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:44.252921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:44.253931 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:44.254893 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:44.254893 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:44.254893 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:44.254893 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:44.255614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 451/918] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:44.255970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 468/919] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:44.259230 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9772-64bd-4c49-aa26-f83ba9b51998 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:44.276164 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545723f7-82e9-4575-8359-6656edff2847 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:44.289815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:44.365639 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:44.374141 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9772-64bd-4c49-aa26-f83ba9b51998 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:44.403637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545723f7-82e9-4575-8359-6656edff2847 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:44.419261 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fd91d-7705-4eea-ad4b-f21b8592a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:44.420200 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fd91d-7705-4eea-ad4b-f21b8592a7dc None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:44.420486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fd91d-7705-4eea-ad4b-f21b8592a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:44.420765 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fd91d-7705-4eea-ad4b-f21b8592a7dc None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:44.421804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fd91d-7705-4eea-ad4b-f21b8592a7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:44.422115 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fd91d-7705-4eea-ad4b-f21b8592a7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:44.423750 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fd91d-7705-4eea-ad4b-f21b8592a7dc None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:44.441238 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 452/920] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:44.446585 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fd91d-7705-4eea-ad4b-f21b8592a7dc None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:44.448562 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf938d5-667e-4874-b2f9-cf831b968b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:44.449442 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf938d5-667e-4874-b2f9-cf831b968b05 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:44.449724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf938d5-667e-4874-b2f9-cf831b968b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:44.450001 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf938d5-667e-4874-b2f9-cf831b968b05 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:44.450700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf938d5-667e-4874-b2f9-cf831b968b05 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:44.452948 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf938d5-667e-4874-b2f9-cf831b968b05 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4cf938d5-667e-4874-b2f9-cf831b968b05 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:44.473153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:44.474476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 10:02:44.475386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:44.481586 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 469/921] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:02:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:44.482844 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf938d5-667e-4874-b2f9-cf831b968b05 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:44.549584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:44.570401 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fd91d-7705-4eea-ad4b-f21b8592a7dc None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:44.610473 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf938d5-667e-4874-b2f9-cf831b968b05 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:44.615887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07aca7e-7553-47dd-bb54-574a31a0b7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:44.616800 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07aca7e-7553-47dd-bb54-574a31a0b7ac None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:44.617199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07aca7e-7553-47dd-bb54-574a31a0b7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:44.617554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07aca7e-7553-47dd-bb54-574a31a0b7ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:44.627428 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07aca7e-7553-47dd-bb54-574a31a0b7ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:44.629582 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07aca7e-7553-47dd-bb54-574a31a0b7ac None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:44.648136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7143805-7960-4b2d-b185-6cbc84b8b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:44.649123 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7143805-7960-4b2d-b185-6cbc84b8b4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:44.649627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7143805-7960-4b2d-b185-6cbc84b8b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:44.650077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7143805-7960-4b2d-b185-6cbc84b8b4b4 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-a07aca7e-7553-47dd-bb54-574a31a0b7ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:44.650853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:44.651752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:44.652694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:44.652694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:44.652694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:44.652694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:44.652694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:44.652694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:44.652694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:44.652694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:44.652694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:44.652694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:44.653943 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7143805-7960-4b2d-b185-6cbc84b8b4b4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:44.654559 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7143805-7960-4b2d-b185-6cbc84b8b4b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:44.656129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7143805-7960-4b2d-b185-6cbc84b8b4b4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:44.656780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 453/922] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 10:02:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:44.658374 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07aca7e-7553-47dd-bb54-574a31a0b7ac None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:44.659771 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:44.667557 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 470/923] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:02:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:44.671558 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7143805-7960-4b2d-b185-6cbc84b8b4b4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:44.781651 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7143805-7960-4b2d-b185-6cbc84b8b4b4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:44.788621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07aca7e-7553-47dd-bb54-574a31a0b7ac None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:44.825845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7683143-e73f-4795-b782-21c7ee6108a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:44.826624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683143-e73f-4795-b782-21c7ee6108a8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:44.826908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683143-e73f-4795-b782-21c7ee6108a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:44.827189 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683143-e73f-4795-b782-21c7ee6108a8 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:44.827841 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8ce4-47a0-4e76-9d14-b0b3759a2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:44.827963 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7683143-e73f-4795-b782-21c7ee6108a8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:44.828195 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7683143-e73f-4795-b782-21c7ee6108a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:44.829058 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8ce4-47a0-4e76-9d14-b0b3759a2c88 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:44.829565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8ce4-47a0-4e76-9d14-b0b3759a2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:44.829684 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7683143-e73f-4795-b782-21c7ee6108a8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:44.830154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8ce4-47a0-4e76-9d14-b0b3759a2c88 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:44.831443 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc8ce4-47a0-4e76-9d14-b0b3759a2c88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:44.832017 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc8ce4-47a0-4e76-9d14-b0b3759a2c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:44.833744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc8ce4-47a0-4e76-9d14-b0b3759a2c88 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:44.835199 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 471/924] 10.222.0.13 () {56 vars in 1114 bytes} [Tue Jul 5 10:02:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:44.840669 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7683143-e73f-4795-b782-21c7ee6108a8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:44.851930 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:44.862095 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 454/925] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 10:02:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:44.863920 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8ce4-47a0-4e76-9d14-b0b3759a2c88 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:44.917626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:44.966897 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7683143-e73f-4795-b782-21c7ee6108a8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:44.974144 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8ce4-47a0-4e76-9d14-b0b3759a2c88 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:45.004717 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d9d01-3509-4ea9-831c-1870f5dd8ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:45.005445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9d01-3509-4ea9-831c-1870f5dd8ec4 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.005722 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9d01-3509-4ea9-831c-1870f5dd8ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.006008 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9d01-3509-4ea9-831c-1870f5dd8ec4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.006742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d9d01-3509-4ea9-831c-1870f5dd8ec4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:45.008110 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d9d01-3509-4ea9-831c-1870f5dd8ec4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:45.010782 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8333b-7c6e-4649-82dc-27d599de3e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:45.011567 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8333b-7c6e-4649-82dc-27d599de3e00 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.011848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8333b-7c6e-4649-82dc-27d599de3e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.012212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8333b-7c6e-4649-82dc-27d599de3e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.025305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8333b-7c6e-4649-82dc-27d599de3e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:45.027028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8333b-7c6e-4649-82dc-27d599de3e00 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:45.032000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 472/926] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 10:02:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:02:45.032000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c861d-1845-4c2a-bd43-bced92e10642 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.032000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c861d-1845-4c2a-bd43-bced92e10642 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.032000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c861d-1845-4c2a-bd43-bced92e10642 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.034914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 473/927] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:45.036681 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ae038-b136-4783-ab3b-f70ed28fccaa None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.036681 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ae038-b136-4783-ab3b-f70ed28fccaa None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.036909 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ae038-b136-4783-ab3b-f70ed28fccaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-26c8333b-7c6e-4649-82dc-27d599de3e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:45.055286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:45.056262 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:45.057165 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:45.057165 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:45.057165 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:45.057165 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:45.057395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c77ae038-b136-4783-ab3b-f70ed28fccaa None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:45.057395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c77ae038-b136-4783-ab3b-f70ed28fccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:45.061108 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 455/928] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:45.063248 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8333b-7c6e-4649-82dc-27d599de3e00 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:45.144175 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:45.148959 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 474/929] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:45.174488 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ae038-b136-4783-ab3b-f70ed28fccaa None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:45.204335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8333b-7c6e-4649-82dc-27d599de3e00 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:45.231749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:45.251664 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff292d3-3c87-4d38-badd-fb7ebd2b1023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:45.252500 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff292d3-3c87-4d38-badd-fb7ebd2b1023 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.252786 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff292d3-3c87-4d38-badd-fb7ebd2b1023 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.253410 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff292d3-3c87-4d38-badd-fb7ebd2b1023 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.254420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff292d3-3c87-4d38-badd-fb7ebd2b1023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:45.254734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff292d3-3c87-4d38-badd-fb7ebd2b1023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:45.256267 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff292d3-3c87-4d38-badd-fb7ebd2b1023 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:45.272499 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 456/930] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:45.278220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff292d3-3c87-4d38-badd-fb7ebd2b1023 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:45.303859 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ae038-b136-4783-ab3b-f70ed28fccaa None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:45.348029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cfc35-37fe-40b5-beac-7b55365f8a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:45.348857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfc35-37fe-40b5-beac-7b55365f8a48 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.349170 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfc35-37fe-40b5-beac-7b55365f8a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.349448 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfc35-37fe-40b5-beac-7b55365f8a48 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.350104 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cfc35-37fe-40b5-beac-7b55365f8a48 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:45.351642 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cfc35-37fe-40b5-beac-7b55365f8a48 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c68cfc35-37fe-40b5-beac-7b55365f8a48 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:45.366262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:45.367225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 10:02:45.368060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:45.375590 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 475/931] 10.222.0.13 () {56 vars in 1132 bytes} [Tue Jul 5 10:02:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:45.377140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cfc35-37fe-40b5-beac-7b55365f8a48 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:45.393182 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff292d3-3c87-4d38-badd-fb7ebd2b1023 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:45.406056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:45.428324 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22feb55-813e-43ff-bbcd-3c4946d23562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:45.429072 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22feb55-813e-43ff-bbcd-3c4946d23562 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.429355 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22feb55-813e-43ff-bbcd-3c4946d23562 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.429630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22feb55-813e-43ff-bbcd-3c4946d23562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.436330 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22feb55-813e-43ff-bbcd-3c4946d23562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:45.437805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22feb55-813e-43ff-bbcd-3c4946d23562 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b22feb55-813e-43ff-bbcd-3c4946d23562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:45.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:45.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:45.453783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:45.453783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:45.453783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:45.453783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:45.453783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:45.453783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:45.453783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:45.453783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:45.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 457/932] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:45.459645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dcc72-bc4f-4f9c-8d37-568df22d6409 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.459937 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dcc72-bc4f-4f9c-8d37-568df22d6409 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.460224 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dcc72-bc4f-4f9c-8d37-568df22d6409 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.461727 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 458/933] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:45.462415 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dcc72-bc4f-4f9c-8d37-568df22d6409 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:45.494367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cfc35-37fe-40b5-beac-7b55365f8a48 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:45.506577 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:45.533141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a4e3a-3161-4e56-802f-0accf23f0aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:45.533802 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a4e3a-3161-4e56-802f-0accf23f0aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.534087 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a4e3a-3161-4e56-802f-0accf23f0aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.534926 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a4e3a-3161-4e56-802f-0accf23f0aa7 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.535623 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a4e3a-3161-4e56-802f-0accf23f0aa7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:45.535928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a4e3a-3161-4e56-802f-0accf23f0aa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:45.537346 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a4e3a-3161-4e56-802f-0accf23f0aa7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:45.546922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 476/934] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 10:02:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:45.546922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e401b7f-5e47-4176-aed9-ddfe1d27201a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.546922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e401b7f-5e47-4176-aed9-ddfe1d27201a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.546922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e401b7f-5e47-4176-aed9-ddfe1d27201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.563784 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4e401b7f-5e47-4176-aed9-ddfe1d27201a None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:45.565070 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4e401b7f-5e47-4176-aed9-ddfe1d27201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:45.572957 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dcc72-bc4f-4f9c-8d37-568df22d6409 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:45.609898 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e4e1e-b94d-453c-956a-bd21ba8034ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:45.610590 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e4e1e-b94d-453c-956a-bd21ba8034ec None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.610853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e4e1e-b94d-453c-956a-bd21ba8034ec None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.611128 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e4e1e-b94d-453c-956a-bd21ba8034ec None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.611909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e4e1e-b94d-453c-956a-bd21ba8034ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:45.612218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e4e1e-b94d-453c-956a-bd21ba8034ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:45.614216 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e4e1e-b94d-453c-956a-bd21ba8034ec None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:45.631362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 459/935] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:45.631362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e4e1e-b94d-453c-956a-bd21ba8034ec None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:45.644625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 477/936] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:45.645488 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e401b7f-5e47-4176-aed9-ddfe1d27201a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:45.667359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:45.740141 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e4e1e-b94d-453c-956a-bd21ba8034ec None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:45.755952 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e401b7f-5e47-4176-aed9-ddfe1d27201a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:45.758272 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:45.776792 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a68f51-e2ba-446e-bcae-7cd6035def34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:45.777489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a68f51-e2ba-446e-bcae-7cd6035def34 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.777774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a68f51-e2ba-446e-bcae-7cd6035def34 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.778047 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a68f51-e2ba-446e-bcae-7cd6035def34 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.779179 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a68f51-e2ba-446e-bcae-7cd6035def34 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:45.779653 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a68f51-e2ba-446e-bcae-7cd6035def34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:45.781045 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a68f51-e2ba-446e-bcae-7cd6035def34 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:45.791030 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 460/937] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 10:02:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:45.791030 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a68f51-e2ba-446e-bcae-7cd6035def34 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:45.798037 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081a8b1-e062-4544-aed3-cae720b4ae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:45.798945 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081a8b1-e062-4544-aed3-cae720b4ae6b None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.799232 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081a8b1-e062-4544-aed3-cae720b4ae6b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.799512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081a8b1-e062-4544-aed3-cae720b4ae6b None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/f2683e79ea804a7987642df32f03fad5/roles/008ab9f39a224eb08f13bc0c9c574e1c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.802365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081a8b1-e062-4544-aed3-cae720b4ae6b None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=f2683e79ea804a7987642df32f03fad5, role_id=008ab9f39a224eb08f13bc0c9c574e1c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:45.803812 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081a8b1-e062-4544-aed3-cae720b4ae6b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:45.820703 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 478/938] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:02:45 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/f2683e79ea804a7987642df32f03fad5/roles/008ab9f39a224eb08f13bc0c9c574e1c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:02:45.829923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081a8b1-e062-4544-aed3-cae720b4ae6b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:45.899671 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:45.910124 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a68f51-e2ba-446e-bcae-7cd6035def34 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:45.951302 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeaded-cfa0-4f53-b1f1-0d766374af65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:45.952563 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeaded-cfa0-4f53-b1f1-0d766374af65 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:45.953150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeaded-cfa0-4f53-b1f1-0d766374af65 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:45.953650 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeaded-cfa0-4f53-b1f1-0d766374af65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:45.954519 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daeaded-cfa0-4f53-b1f1-0d766374af65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:45.956270 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daeaded-cfa0-4f53-b1f1-0d766374af65 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-3daeaded-cfa0-4f53-b1f1-0d766374af65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:45.969723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:45.970766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:45.971621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:45.974812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 461/939] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 10:02:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:45.978387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081a8b1-e062-4544-aed3-cae720b4ae6b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:45.981127 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeaded-cfa0-4f53-b1f1-0d766374af65 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:46.021107 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ec28c-4652-4824-a83b-edb727c18fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:46.021776 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ec28c-4652-4824-a83b-edb727c18fd1 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:46.022057 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ec28c-4652-4824-a83b-edb727c18fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:46.022335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ec28c-4652-4824-a83b-edb727c18fd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:46.023165 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ec28c-4652-4824-a83b-edb727c18fd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:46.024532 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ec28c-4652-4824-a83b-edb727c18fd1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:46.051062 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 479/940] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 10:02:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:46.107685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeaded-cfa0-4f53-b1f1-0d766374af65 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:46.152488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6fe9-a124-44fc-9a62-bd1716777238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:46.153199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6fe9-a124-44fc-9a62-bd1716777238 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:46.153488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6fe9-a124-44fc-9a62-bd1716777238 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:46.153769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6fe9-a124-44fc-9a62-bd1716777238 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:46.154483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6fe9-a124-44fc-9a62-bd1716777238 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:46.154794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6fe9-a124-44fc-9a62-bd1716777238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:46.156192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6fe9-a124-44fc-9a62-bd1716777238 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:46.167110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 462/941] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 10:02:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:46.170335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ec28c-4652-4824-a83b-edb727c18fd1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:46.195265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:46.285688 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ec28c-4652-4824-a83b-edb727c18fd1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:46.324493 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363995b-c86f-4905-b2cd-758f20fc8013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:46.325210 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363995b-c86f-4905-b2cd-758f20fc8013 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:46.325768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363995b-c86f-4905-b2cd-758f20fc8013 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:46.325768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363995b-c86f-4905-b2cd-758f20fc8013 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:46.326456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363995b-c86f-4905-b2cd-758f20fc8013 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:46.326762 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363995b-c86f-4905-b2cd-758f20fc8013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:46.328124 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363995b-c86f-4905-b2cd-758f20fc8013 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:46.334323 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 480/942] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 10:02:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:46.340029 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6fe9-a124-44fc-9a62-bd1716777238 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:46.363643 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:46.444481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6fe9-a124-44fc-9a62-bd1716777238 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:46.479717 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f37d5-1e81-4a97-8818-41e115318c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:46.480380 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f37d5-1e81-4a97-8818-41e115318c6e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:46.480667 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f37d5-1e81-4a97-8818-41e115318c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:46.480973 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f37d5-1e81-4a97-8818-41e115318c6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:46.481769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f37d5-1e81-4a97-8818-41e115318c6e None admin] RBAC: Adding query filter params (interface=public, service_id=b0423b10376c41fab505ae70109f6796, region_id=RegionOne) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:46.482083 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f37d5-1e81-4a97-8818-41e115318c6e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:46.483461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f37d5-1e81-4a97-8818-41e115318c6e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:46.493051 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 463/943] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 10:02:46 2022] GET /identity/v3/endpoints?service_id=b0423b10376c41fab505ae70109f6796&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:46.494933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363995b-c86f-4905-b2cd-758f20fc8013 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:46.583451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:46.601383 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363995b-c86f-4905-b2cd-758f20fc8013 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:46.635995 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff3378-5271-41e6-a46a-047c738c7fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:46.636663 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff3378-5271-41e6-a46a-047c738c7fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:46.636967 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff3378-5271-41e6-a46a-047c738c7fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:46.637245 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff3378-5271-41e6-a46a-047c738c7fb2 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:46.637923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff3378-5271-41e6-a46a-047c738c7fb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:46.639281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff3378-5271-41e6-a46a-047c738c7fb2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:46.646393 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 481/944] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 10:02:46 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:02:47.194541 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23c01f-19c2-4de4-8dce-194054600e02 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:47.195090 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23c01f-19c2-4de4-8dce-194054600e02 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:47.195090 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23c01f-19c2-4de4-8dce-194054600e02 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:47.196724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 464/945] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:47.201895 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f0add-4e14-4853-810d-0b2a3b1734a6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:47.202342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f0add-4e14-4853-810d-0b2a3b1734a6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:47.202509 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f0add-4e14-4853-810d-0b2a3b1734a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:47.222182 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d83f0add-4e14-4853-810d-0b2a3b1734a6 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:47.223643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d83f0add-4e14-4853-810d-0b2a3b1734a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:47.302445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 482/946] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:47.325520 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23c01f-19c2-4de4-8dce-194054600e02 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:47.413241 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:47.429904 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23c01f-19c2-4de4-8dce-194054600e02 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:47.464801 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cbf00-5eed-4a91-83df-379de07630c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:47.465426 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cbf00-5eed-4a91-83df-379de07630c7 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:47.465712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cbf00-5eed-4a91-83df-379de07630c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:47.465990 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cbf00-5eed-4a91-83df-379de07630c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:47.466687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cbf00-5eed-4a91-83df-379de07630c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:47.468181 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cbf00-5eed-4a91-83df-379de07630c7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:47.469577 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: WARNING keystone.server.flask.common [None req-7d1cbf00-5eed-4a91-83df-379de07630c7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 10:02:47.489128 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.sql.core [None req-7d1cbf00-5eed-4a91-83df-379de07630c7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 10:02:47.489128 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 10:02:47.489128 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [parameters: {'id': '9964000440c94b3bbc4dd2ef8a31140c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 10:02:47.489128 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80360) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-7d1cbf00-5eed-4a91-83df-379de07630c7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9964000440c94b3bbc4dd2ef8a31140c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9964000440c94b3bbc4dd2ef8a31140c. Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application conn.query(q) Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 10:02:47.506508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result.read() Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 05 10:02:47.507339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application next(self.gen) Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application yield resource Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application next(self.gen) Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise self.value Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application session.commit() Jul 05 10:02:47.508301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.session.flush() Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application compat.raise_( Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 10:02:47.509206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 10:02:47.510087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application conn.query(q) Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result.read() Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 10:02:47.510861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [parameters: {'id': '9964000440c94b3bbc4dd2ef8a31140c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:47.511712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:47.512487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:47.515833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:47.515833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 05 10:02:47.515833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 05 10:02:47.515833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:47.515833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:47.515833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 05 10:02:47.515833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 05 10:02:47.515833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9964000440c94b3bbc4dd2ef8a31140c. Jul 05 10:02:47.515833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:47.515833 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 465/947] 10.222.0.13 () {60 vars in 1140 bytes} [Tue Jul 5 10:02:47 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:47.516693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f0add-4e14-4853-810d-0b2a3b1734a6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:47.598230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:47.622522 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f0add-4e14-4853-810d-0b2a3b1734a6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:47.659555 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c510a3-8199-49e6-a185-7b88527e14d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:47.660363 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c510a3-8199-49e6-a185-7b88527e14d1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:47.660644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c510a3-8199-49e6-a185-7b88527e14d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:47.660951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c510a3-8199-49e6-a185-7b88527e14d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:47.667938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c510a3-8199-49e6-a185-7b88527e14d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:47.669414 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c510a3-8199-49e6-a185-7b88527e14d1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-24c510a3-8199-49e6-a185-7b88527e14d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:47.684564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:47.686625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:47.687908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:47.687908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:47.687908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:47.687908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:47.687908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:47.687908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:47.687908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:47.687908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:47.687908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 483/948] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:47.691854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cbf00-5eed-4a91-83df-379de07630c7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:47.802033 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cbf00-5eed-4a91-83df-379de07630c7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:47.839106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbc4db-789c-4e88-a788-c164c88c7fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:47.840248 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc4db-789c-4e88-a788-c164c88c7fcb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:47.840771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc4db-789c-4e88-a788-c164c88c7fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:47.841328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc4db-789c-4e88-a788-c164c88c7fcb None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:47.842783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbc4db-789c-4e88-a788-c164c88c7fcb None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:47.843360 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbc4db-789c-4e88-a788-c164c88c7fcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:47.846520 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbc4db-789c-4e88-a788-c164c88c7fcb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:47.868480 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:47.875490 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 466/949] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:48.009646 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c182b3-edbd-4783-8082-be178b7851a9 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.010174 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c182b3-edbd-4783-8082-be178b7851a9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.010600 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c182b3-edbd-4783-8082-be178b7851a9 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.012383 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 484/950] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:48.018626 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20acf3-a810-4e54-9a32-cf0b9308a572 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.019306 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20acf3-a810-4e54-9a32-cf0b9308a572 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.019824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20acf3-a810-4e54-9a32-cf0b9308a572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.038637 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-de20acf3-a810-4e54-9a32-cf0b9308a572 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:48.040466 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-de20acf3-a810-4e54-9a32-cf0b9308a572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:48.114252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 467/951] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:48.137700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c182b3-edbd-4783-8082-be178b7851a9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:48.242352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c182b3-edbd-4783-8082-be178b7851a9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:48.261591 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70d08-c90c-467b-8c83-7efb38ef67a7 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.262111 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70d08-c90c-467b-8c83-7efb38ef67a7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.262196 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e70d08-c90c-467b-8c83-7efb38ef67a7 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.263778 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 468/952] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:02:48.268783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305ff13-6b19-4192-a529-9678f8682dfe None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.269107 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305ff13-6b19-4192-a529-9678f8682dfe None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.269394 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305ff13-6b19-4192-a529-9678f8682dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.282235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd5922-f0eb-459b-a4a9-518e4340f74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:48.287863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5305ff13-6b19-4192-a529-9678f8682dfe None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:48.289250 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5305ff13-6b19-4192-a529-9678f8682dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:48.289687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd5922-f0eb-459b-a4a9-518e4340f74a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.290137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd5922-f0eb-459b-a4a9-518e4340f74a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.290569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd5922-f0eb-459b-a4a9-518e4340f74a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.304159 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:48.310215 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd5922-f0eb-459b-a4a9-518e4340f74a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-26dd5922-f0eb-459b-a4a9-518e4340f74a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:48.319178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:48.320114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:48.320970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 485/953] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 10:02:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:48.327995 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd5922-f0eb-459b-a4a9-518e4340f74a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:48.380264 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 469/954] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:48.401760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305ff13-6b19-4192-a529-9678f8682dfe None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:48.459452 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd5922-f0eb-459b-a4a9-518e4340f74a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:48.465391 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:48.509160 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbb2ab-3a3e-4fd4-ab2f-01ca656d292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:48.509835 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb2ab-3a3e-4fd4-ab2f-01ca656d292c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.510120 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb2ab-3a3e-4fd4-ab2f-01ca656d292c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.510394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb2ab-3a3e-4fd4-ab2f-01ca656d292c None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.511127 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305ff13-6b19-4192-a529-9678f8682dfe None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:48.511252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbb2ab-3a3e-4fd4-ab2f-01ca656d292c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:48.511428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbb2ab-3a3e-4fd4-ab2f-01ca656d292c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:48.512976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbb2ab-3a3e-4fd4-ab2f-01ca656d292c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:48.524981 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 486/955] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 10:02:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:48.529407 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbb2ab-3a3e-4fd4-ab2f-01ca656d292c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:48.558469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276c9d5-d330-45fa-b958-c9e2162b4e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:48.559521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276c9d5-d330-45fa-b958-c9e2162b4e38 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.559801 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276c9d5-d330-45fa-b958-c9e2162b4e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.560315 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276c9d5-d330-45fa-b958-c9e2162b4e38 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.561021 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276c9d5-d330-45fa-b958-c9e2162b4e38 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:48.563015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276c9d5-d330-45fa-b958-c9e2162b4e38 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-9276c9d5-d330-45fa-b958-c9e2162b4e38 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:48.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:48.580425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:48.581759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 470/956] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:48.587110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276c9d5-d330-45fa-b958-c9e2162b4e38 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:48.600818 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:48.647703 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbb2ab-3a3e-4fd4-ab2f-01ca656d292c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:48.690500 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435c1db-d2cf-4193-b26b-c484c248c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:48.691625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435c1db-d2cf-4193-b26b-c484c248c166 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.691912 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435c1db-d2cf-4193-b26b-c484c248c166 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.692551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435c1db-d2cf-4193-b26b-c484c248c166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.707004 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435c1db-d2cf-4193-b26b-c484c248c166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:48.709139 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435c1db-d2cf-4193-b26b-c484c248c166 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:48.713790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276c9d5-d330-45fa-b958-c9e2162b4e38 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-7435c1db-d2cf-4193-b26b-c484c248c166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:48.730999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:48.733065 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:48.734555 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:48.734555 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:48.734555 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:48.734555 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:48.740916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 487/957] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:48.740916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435c1db-d2cf-4193-b26b-c484c248c166 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:48.744236 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:48.756735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0217368-e2bb-4101-864c-e8ffe14ff1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:48.757475 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0217368-e2bb-4101-864c-e8ffe14ff1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.757737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0217368-e2bb-4101-864c-e8ffe14ff1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.758023 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0217368-e2bb-4101-864c-e8ffe14ff1c8 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.758730 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0217368-e2bb-4101-864c-e8ffe14ff1c8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:48.759046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0217368-e2bb-4101-864c-e8ffe14ff1c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:48.760449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0217368-e2bb-4101-864c-e8ffe14ff1c8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:48.770890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 471/958] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:48.770890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43005684-6116-409f-9be5-9d8b6be22e2a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.770890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43005684-6116-409f-9be5-9d8b6be22e2a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.770890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43005684-6116-409f-9be5-9d8b6be22e2a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.770890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 472/959] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:48.771619 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43005684-6116-409f-9be5-9d8b6be22e2a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:48.856794 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435c1db-d2cf-4193-b26b-c484c248c166 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:48.870132 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:48.880127 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43005684-6116-409f-9be5-9d8b6be22e2a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:48.891820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d507f92-f1a8-461d-b287-b5c2bf8dfc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:48.892520 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507f92-f1a8-461d-b287-b5c2bf8dfc62 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.892808 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507f92-f1a8-461d-b287-b5c2bf8dfc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.893106 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507f92-f1a8-461d-b287-b5c2bf8dfc62 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.893841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d507f92-f1a8-461d-b287-b5c2bf8dfc62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:48.894147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d507f92-f1a8-461d-b287-b5c2bf8dfc62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:48.895498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d507f92-f1a8-461d-b287-b5c2bf8dfc62 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:48.910016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 488/960] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:48.911896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3edbe1-5e03-4e2b-b1d4-643ea7560a24 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.912678 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3edbe1-5e03-4e2b-b1d4-643ea7560a24 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.913134 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3edbe1-5e03-4e2b-b1d4-643ea7560a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.917579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846a9a4-b727-405d-8212-01de21603cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:48.918247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846a9a4-b727-405d-8212-01de21603cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:48.918711 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846a9a4-b727-405d-8212-01de21603cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:48.918917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846a9a4-b727-405d-8212-01de21603cc6 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:48.919988 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846a9a4-b727-405d-8212-01de21603cc6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:48.920297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846a9a4-b727-405d-8212-01de21603cc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:48.921695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846a9a4-b727-405d-8212-01de21603cc6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:48.931016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2d3edbe1-5e03-4e2b-b1d4-643ea7560a24 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:48.932240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2d3edbe1-5e03-4e2b-b1d4-643ea7560a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:48.933284 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 473/961] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:48.934773 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846a9a4-b727-405d-8212-01de21603cc6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:49.010605 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:49.017350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 489/962] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:49.038247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3edbe1-5e03-4e2b-b1d4-643ea7560a24 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:49.073071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846a9a4-b727-405d-8212-01de21603cc6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:49.132312 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04944700-fdc1-4ae9-9df2-ac34a118c282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:49.133457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04944700-fdc1-4ae9-9df2-ac34a118c282 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:49.133906 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04944700-fdc1-4ae9-9df2-ac34a118c282 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:49.134256 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04944700-fdc1-4ae9-9df2-ac34a118c282 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:49.142918 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04944700-fdc1-4ae9-9df2-ac34a118c282 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:49.145476 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04944700-fdc1-4ae9-9df2-ac34a118c282 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:49.158742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3edbe1-5e03-4e2b-b1d4-643ea7560a24 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:49.160441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-04944700-fdc1-4ae9-9df2-ac34a118c282 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:49.165853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:49.166895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:49.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:49.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:49.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:49.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:49.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:49.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:49.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:49.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:49.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 10:02:49.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:49.167854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 474/963] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 10:02:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:49.178150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04944700-fdc1-4ae9-9df2-ac34a118c282 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:49.199776 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28589bea-7f4e-4518-8f1d-0508c189623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:49.200609 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28589bea-7f4e-4518-8f1d-0508c189623a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:49.201179 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28589bea-7f4e-4518-8f1d-0508c189623a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:49.201523 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28589bea-7f4e-4518-8f1d-0508c189623a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:49.202679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28589bea-7f4e-4518-8f1d-0508c189623a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:49.204470 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28589bea-7f4e-4518-8f1d-0508c189623a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-28589bea-7f4e-4518-8f1d-0508c189623a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:49.220365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:49.221499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:49.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:49.223312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 490/964] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 10:02:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:49.228290 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28589bea-7f4e-4518-8f1d-0508c189623a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:49.323644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04944700-fdc1-4ae9-9df2-ac34a118c282 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:49.338381 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:49.361434 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ba2ee-162b-47c8-82c6-85a89b3ff4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:49.362106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ba2ee-162b-47c8-82c6-85a89b3ff4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:49.362988 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ba2ee-162b-47c8-82c6-85a89b3ff4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:49.363266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ba2ee-162b-47c8-82c6-85a89b3ff4d0 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:49.364112 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ba2ee-162b-47c8-82c6-85a89b3ff4d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:49.364418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ba2ee-162b-47c8-82c6-85a89b3ff4d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:49.365883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ba2ee-162b-47c8-82c6-85a89b3ff4d0 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:49.384761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 475/965] 10.222.0.13 () {56 vars in 1149 bytes} [Tue Jul 5 10:02:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:49.386519 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28589bea-7f4e-4518-8f1d-0508c189623a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:49.389877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ba2ee-162b-47c8-82c6-85a89b3ff4d0 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:49.435326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f0762-5fff-45b0-9e50-b295082908ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:49.435326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f0762-5fff-45b0-9e50-b295082908ed None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:49.435326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f0762-5fff-45b0-9e50-b295082908ed None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:49.435326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f0762-5fff-45b0-9e50-b295082908ed None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:49.435717 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f0762-5fff-45b0-9e50-b295082908ed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:49.435997 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f0762-5fff-45b0-9e50-b295082908ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:49.437771 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f0762-5fff-45b0-9e50-b295082908ed None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:49.444923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 491/966] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 10:02:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:49.452568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f0762-5fff-45b0-9e50-b295082908ed None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:49.501836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:49.509878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ba2ee-162b-47c8-82c6-85a89b3ff4d0 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:49.549191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5db37d-b904-4ba8-b436-906788baf60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:49.550278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db37d-b904-4ba8-b436-906788baf60b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:49.550772 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db37d-b904-4ba8-b436-906788baf60b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:49.551261 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db37d-b904-4ba8-b436-906788baf60b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:49.595247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:49.598809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f0762-5fff-45b0-9e50-b295082908ed None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:49.631446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5db37d-b904-4ba8-b436-906788baf60b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:49.633457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5db37d-b904-4ba8-b436-906788baf60b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:49.643482 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f963d59-6d0c-415d-bfca-27745d39bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:49.645084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f963d59-6d0c-415d-bfca-27745d39bb50 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:49.645595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f963d59-6d0c-415d-bfca-27745d39bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:49.646143 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f963d59-6d0c-415d-bfca-27745d39bb50 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:49.647049 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f963d59-6d0c-415d-bfca-27745d39bb50 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:49.647557 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f963d59-6d0c-415d-bfca-27745d39bb50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:49.649192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f963d59-6d0c-415d-bfca-27745d39bb50 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:49.654904 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 492/967] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 10:02:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:49.661150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f963d59-6d0c-415d-bfca-27745d39bb50 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:49.757792 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 476/968] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:02:49 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:02:49.763323 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5db37d-b904-4ba8-b436-906788baf60b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:49.778809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:49.790011 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f963d59-6d0c-415d-bfca-27745d39bb50 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:49.837038 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd83c6-bcd8-4743-80e3-00a03291a755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:49.838025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd83c6-bcd8-4743-80e3-00a03291a755 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:49.838360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd83c6-bcd8-4743-80e3-00a03291a755 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:49.838648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd83c6-bcd8-4743-80e3-00a03291a755 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:49.839967 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd83c6-bcd8-4743-80e3-00a03291a755 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:49.841677 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd83c6-bcd8-4743-80e3-00a03291a755 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:49.843106 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:49.873527 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 493/969] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 10:02:49 2022] POST /identity/v3/endpoints => generated 349 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:49.889500 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5db37d-b904-4ba8-b436-906788baf60b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:49.939185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23d7f7-f115-49a4-b82f-7da30729ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:49.940051 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23d7f7-f115-49a4-b82f-7da30729ed9c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:49.940340 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23d7f7-f115-49a4-b82f-7da30729ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:49.940650 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23d7f7-f115-49a4-b82f-7da30729ed9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:49.953629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23d7f7-f115-49a4-b82f-7da30729ed9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:49.955134 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23d7f7-f115-49a4-b82f-7da30729ed9c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-2b23d7f7-f115-49a4-b82f-7da30729ed9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:49.975824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:49.976810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:49.977726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:49.977726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:49.977726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:49.977726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:49.977726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 477/970] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:49.984237 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd83c6-bcd8-4743-80e3-00a03291a755 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:50.087362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a895d75-bc59-440e-ae70-a9da9044e702 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:50.087682 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a895d75-bc59-440e-ae70-a9da9044e702 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:50.087878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a895d75-bc59-440e-ae70-a9da9044e702 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:50.093521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 478/971] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:50.096312 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd83c6-bcd8-4743-80e3-00a03291a755 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:50.096487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a9c7c-1902-4cee-90a7-54b5ec3b8345 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:50.096487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a9c7c-1902-4cee-90a7-54b5ec3b8345 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:50.097388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a9c7c-1902-4cee-90a7-54b5ec3b8345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:50.116418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-cc0a9c7c-1902-4cee-90a7-54b5ec3b8345 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:50.117710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-cc0a9c7c-1902-4cee-90a7-54b5ec3b8345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:50.133694 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8192ecd-e456-4f20-9c1c-b9f6d0a2f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:50.134740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8192ecd-e456-4f20-9c1c-b9f6d0a2f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:50.135244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8192ecd-e456-4f20-9c1c-b9f6d0a2f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:50.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8192ecd-e456-4f20-9c1c-b9f6d0a2f1f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:50.136653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8192ecd-e456-4f20-9c1c-b9f6d0a2f1f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:50.137193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8192ecd-e456-4f20-9c1c-b9f6d0a2f1f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:50.138786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8192ecd-e456-4f20-9c1c-b9f6d0a2f1f3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:50.153001 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 494/972] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:50.158370 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8192ecd-e456-4f20-9c1c-b9f6d0a2f1f3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:50.174592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:50.211550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 479/973] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:50.242677 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a9c7c-1902-4cee-90a7-54b5ec3b8345 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:50.279386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8192ecd-e456-4f20-9c1c-b9f6d0a2f1f3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:50.314907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:50.331309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d1520-3008-4323-a8e1-5ec342d8705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:50.332262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d1520-3008-4323-a8e1-5ec342d8705e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:50.332646 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d1520-3008-4323-a8e1-5ec342d8705e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:50.333053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d1520-3008-4323-a8e1-5ec342d8705e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:50.342595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d1520-3008-4323-a8e1-5ec342d8705e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:50.344606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d1520-3008-4323-a8e1-5ec342d8705e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-9c9d1520-3008-4323-a8e1-5ec342d8705e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:02:50.364630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:50.365768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:50.366729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:02:50.366729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:02:50.366729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:02:50.366729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:02:50.366729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:02:50.366729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:02:50.366729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:02:50.366729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:50.369036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 495/974] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:50.373848 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d1520-3008-4323-a8e1-5ec342d8705e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:50.379827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a9c7c-1902-4cee-90a7-54b5ec3b8345 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:50.415930 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94cb91-0f1d-48e7-aaa8-a1ff4d176921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:50.416592 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94cb91-0f1d-48e7-aaa8-a1ff4d176921 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:50.416940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94cb91-0f1d-48e7-aaa8-a1ff4d176921 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:50.417222 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94cb91-0f1d-48e7-aaa8-a1ff4d176921 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:50.418103 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94cb91-0f1d-48e7-aaa8-a1ff4d176921 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:50.419845 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94cb91-0f1d-48e7-aaa8-a1ff4d176921 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:50.433514 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.sql.core [None req-4f94cb91-0f1d-48e7-aaa8-a1ff4d176921 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 10:02:50.433514 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 10:02:50.433514 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [parameters: {'user_id': 'db71d6897bb54df8b187944e361ff7b8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 10:02:50.433514 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80360) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-4f94cb91-0f1d-48e7-aaa8-a1ff4d176921 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application conn.query(q) Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result.read() Jul 05 10:02:50.441436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 10:02:50.442344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application next(self.gen) Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application yield resource Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application next(self.gen) Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise self.value Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application session.commit() Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 10:02:50.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.session.flush() Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application compat.raise_( Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 10:02:50.449629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 10:02:50.450521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application conn.query(q) Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application result.read() Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 10:02:50.451345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [parameters: {'user_id': 'db71d6897bb54df8b187944e361ff7b8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:50.452257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 05 10:02:50.454335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 05 10:02:50.456762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 05 10:02:50.456762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 05 10:02:50.456762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 10:02:50.456762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 10:02:50.456762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 10:02:50.456762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:50.456762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 480/975] 10.222.0.13 () {60 vars in 1131 bytes} [Tue Jul 5 10:02:50 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:50.456762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94cb91-0f1d-48e7-aaa8-a1ff4d176921 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:50.477031 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d1520-3008-4323-a8e1-5ec342d8705e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:50.551920 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836b971-6d2e-4b05-bb2c-096effbf37c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:50.552977 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836b971-6d2e-4b05-bb2c-096effbf37c5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:50.553571 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836b971-6d2e-4b05-bb2c-096effbf37c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:50.554052 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836b971-6d2e-4b05-bb2c-096effbf37c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:50.555046 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836b971-6d2e-4b05-bb2c-096effbf37c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:50.555560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836b971-6d2e-4b05-bb2c-096effbf37c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:50.557377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836b971-6d2e-4b05-bb2c-096effbf37c5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:50.566217 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94cb91-0f1d-48e7-aaa8-a1ff4d176921 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:50.576736 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 496/976] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:50.578005 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:50.578913 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836b971-6d2e-4b05-bb2c-096effbf37c5 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:50.606734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b445f4c-dff5-4d9c-b6c1-f1f4fdbe8171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:50.607457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b445f4c-dff5-4d9c-b6c1-f1f4fdbe8171 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:50.607741 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b445f4c-dff5-4d9c-b6c1-f1f4fdbe8171 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:50.608015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b445f4c-dff5-4d9c-b6c1-f1f4fdbe8171 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:50.616220 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b445f4c-dff5-4d9c-b6c1-f1f4fdbe8171 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:50.618074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b445f4c-dff5-4d9c-b6c1-f1f4fdbe8171 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-6b445f4c-dff5-4d9c-b6c1-f1f4fdbe8171 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:02:50.634641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:50.635805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:50.636846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:50.636846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:50.636846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:02:50.636846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:02:50.636846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:02:50.636846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:02:50.636846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:02:50.636846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:02:50.636846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 10:02:50.636846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:50.640606 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 481/977] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:02:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:50.641512 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b445f4c-dff5-4d9c-b6c1-f1f4fdbe8171 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:50.695348 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836b971-6d2e-4b05-bb2c-096effbf37c5 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:50.727222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:50.733794 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dcb66-a43b-4461-8d66-c762e6ca2c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:50.734723 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dcb66-a43b-4461-8d66-c762e6ca2c77 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:50.735156 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dcb66-a43b-4461-8d66-c762e6ca2c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:50.735576 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dcb66-a43b-4461-8d66-c762e6ca2c77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:50.736569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dcb66-a43b-4461-8d66-c762e6ca2c77 None admin] RBAC: Adding query filter params (role.id=008ab9f39a224eb08f13bc0c9c574e1c, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=f2683e79ea804a7987642df32f03fad5) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:50.737213 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dcb66-a43b-4461-8d66-c762e6ca2c77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:50.739520 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dcb66-a43b-4461-8d66-c762e6ca2c77 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:50.746882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 497/978] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:02:50 2022] GET /identity/v3/role_assignments?user.id=f2683e79ea804a7987642df32f03fad5&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=008ab9f39a224eb08f13bc0c9c574e1c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:50.756935 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b445f4c-dff5-4d9c-b6c1-f1f4fdbe8171 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:50.789909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067dfe6-660b-4028-b7c5-b1830a724e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:50.790709 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067dfe6-660b-4028-b7c5-b1830a724e51 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:50.790996 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067dfe6-660b-4028-b7c5-b1830a724e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:50.791274 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067dfe6-660b-4028-b7c5-b1830a724e51 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:50.792095 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067dfe6-660b-4028-b7c5-b1830a724e51 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:50.792602 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067dfe6-660b-4028-b7c5-b1830a724e51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:50.794124 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067dfe6-660b-4028-b7c5-b1830a724e51 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:50.838724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 482/979] 10.222.0.13 () {56 vars in 1101 bytes} [Tue Jul 5 10:02:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:51.066194 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a81486-a235-4bf5-8d55-0f0794ef1b90 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:51.066489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a81486-a235-4bf5-8d55-0f0794ef1b90 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:51.066778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a81486-a235-4bf5-8d55-0f0794ef1b90 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:51.068440 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 498/980] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:51.074282 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c257a-1d50-4acf-a3fb-c6d851b4d161 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:51.074866 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c257a-1d50-4acf-a3fb-c6d851b4d161 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:51.075145 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c257a-1d50-4acf-a3fb-c6d851b4d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:51.093256 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d11c257a-1d50-4acf-a3fb-c6d851b4d161 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:51.094882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d11c257a-1d50-4acf-a3fb-c6d851b4d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:51.120232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:51.168942 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 483/981] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:51.190073 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a81486-a235-4bf5-8d55-0f0794ef1b90 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:51.302121 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a81486-a235-4bf5-8d55-0f0794ef1b90 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:51.337549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee36cd3-3095-4661-a419-08eac46b74bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:51.338149 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee36cd3-3095-4661-a419-08eac46b74bb None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:51.338436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee36cd3-3095-4661-a419-08eac46b74bb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:51.338716 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee36cd3-3095-4661-a419-08eac46b74bb None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:51.339460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee36cd3-3095-4661-a419-08eac46b74bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:51.340823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee36cd3-3095-4661-a419-08eac46b74bb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:51.357117 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 499/982] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:02:51 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:02:51.967529 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94046c43-4dd6-45b9-b625-848499a9512f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:51.968105 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94046c43-4dd6-45b9-b625-848499a9512f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:51.968105 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94046c43-4dd6-45b9-b625-848499a9512f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:51.969659 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 484/983] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:51.974791 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1f300-6ce2-4289-b338-43800d5c7b01 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:51.975208 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1f300-6ce2-4289-b338-43800d5c7b01 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:51.975388 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1f300-6ce2-4289-b338-43800d5c7b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:51.991865 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a9a1f300-6ce2-4289-b338-43800d5c7b01 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:51.993061 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a9a1f300-6ce2-4289-b338-43800d5c7b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:52.046332 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:52.073142 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 500/984] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:52.095719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94046c43-4dd6-45b9-b625-848499a9512f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:52.195801 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94046c43-4dd6-45b9-b625-848499a9512f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:52.228121 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbe2df-4629-4abb-a4d5-8dfe9a52861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:52.228848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbe2df-4629-4abb-a4d5-8dfe9a52861f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:52.229150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbe2df-4629-4abb-a4d5-8dfe9a52861f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:52.229427 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbe2df-4629-4abb-a4d5-8dfe9a52861f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:52.230076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbe2df-4629-4abb-a4d5-8dfe9a52861f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:52.231436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbe2df-4629-4abb-a4d5-8dfe9a52861f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b8fbe2df-4629-4abb-a4d5-8dfe9a52861f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:52.243753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:52.244737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:52.245630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:52.246996 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 485/985] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 10:02:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:52.250850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1f300-6ce2-4289-b338-43800d5c7b01 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:52.374067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1f300-6ce2-4289-b338-43800d5c7b01 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:52.410598 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bf95b-f3e4-424b-980e-736bf6592637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:52.412013 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bf95b-f3e4-424b-980e-736bf6592637 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:52.412641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bf95b-f3e4-424b-980e-736bf6592637 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:52.413155 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bf95b-f3e4-424b-980e-736bf6592637 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:52.414011 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bf95b-f3e4-424b-980e-736bf6592637 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:52.414464 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bf95b-f3e4-424b-980e-736bf6592637 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:52.416168 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bf95b-f3e4-424b-980e-736bf6592637 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:52.422002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 501/986] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 10:02:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:52.427812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbe2df-4629-4abb-a4d5-8dfe9a52861f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:52.453474 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:52.531872 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbe2df-4629-4abb-a4d5-8dfe9a52861f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:52.565075 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a7221-7764-45c8-a2b9-3c7ed3d7fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:52.566351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7221-7764-45c8-a2b9-3c7ed3d7fc1c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:52.566635 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7221-7764-45c8-a2b9-3c7ed3d7fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:52.566909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7221-7764-45c8-a2b9-3c7ed3d7fc1c None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:52.567603 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7221-7764-45c8-a2b9-3c7ed3d7fc1c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:52.567907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7221-7764-45c8-a2b9-3c7ed3d7fc1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:52.569294 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7221-7764-45c8-a2b9-3c7ed3d7fc1c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:52.579162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 486/987] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 10:02:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:52.580449 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bf95b-f3e4-424b-980e-736bf6592637 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:52.631461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:52.687411 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bf95b-f3e4-424b-980e-736bf6592637 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:52.721372 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b394cf-d5fe-4ddc-9041-6c1a3dbc168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:52.722055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b394cf-d5fe-4ddc-9041-6c1a3dbc168c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:52.722340 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b394cf-d5fe-4ddc-9041-6c1a3dbc168c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:52.722615 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b394cf-d5fe-4ddc-9041-6c1a3dbc168c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:52.723399 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b394cf-d5fe-4ddc-9041-6c1a3dbc168c None admin] RBAC: Adding query filter params (interface=admin, service_id=b0423b10376c41fab505ae70109f6796, region_id=RegionOne) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:52.723709 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b394cf-d5fe-4ddc-9041-6c1a3dbc168c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:52.725117 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b394cf-d5fe-4ddc-9041-6c1a3dbc168c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:52.734675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 502/988] 10.222.0.13 () {56 vars in 1249 bytes} [Tue Jul 5 10:02:52 2022] GET /identity/v3/endpoints?service_id=b0423b10376c41fab505ae70109f6796&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:52.735797 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a7221-7764-45c8-a2b9-3c7ed3d7fc1c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:52.810062 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f12d4-c091-4929-af6e-1e453325e971 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:52.810373 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f12d4-c091-4929-af6e-1e453325e971 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:52.810548 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f12d4-c091-4929-af6e-1e453325e971 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:52.812051 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 503/989] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:02:52.817232 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343900c-0a70-4fd2-a754-7e04ab677011 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:52.817527 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343900c-0a70-4fd2-a754-7e04ab677011 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:52.817808 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343900c-0a70-4fd2-a754-7e04ab677011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:52.825174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:52.837638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5343900c-0a70-4fd2-a754-7e04ab677011 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:52.838823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5343900c-0a70-4fd2-a754-7e04ab677011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:52.840010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a7221-7764-45c8-a2b9-3c7ed3d7fc1c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:52.877643 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5f299-dac4-42fe-80f0-0bc0fb7f415a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:52.878336 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f299-dac4-42fe-80f0-0bc0fb7f415a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:52.878618 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f299-dac4-42fe-80f0-0bc0fb7f415a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:52.878891 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f299-dac4-42fe-80f0-0bc0fb7f415a None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:52.879564 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5f299-dac4-42fe-80f0-0bc0fb7f415a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:52.880940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5f299-dac4-42fe-80f0-0bc0fb7f415a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:52.887769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 487/990] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 10:02:52 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:02:52.911594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 504/991] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:52.934528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5f299-dac4-42fe-80f0-0bc0fb7f415a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:53.064539 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5f299-dac4-42fe-80f0-0bc0fb7f415a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:53.101358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935820a-e30e-4e8e-9b7d-4bc32c42b53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:53.102433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935820a-e30e-4e8e-9b7d-4bc32c42b53e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:53.102866 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935820a-e30e-4e8e-9b7d-4bc32c42b53e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:53.103300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935820a-e30e-4e8e-9b7d-4bc32c42b53e None admin] PATH_INFO: `/v3/services/image` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:53.104094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935820a-e30e-4e8e-9b7d-4bc32c42b53e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:53.105649 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935820a-e30e-4e8e-9b7d-4bc32c42b53e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-b935820a-e30e-4e8e-9b7d-4bc32c42b53e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:53.117586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:53.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 10:02:53.119799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:53.121985 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 488/992] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Jul 5 10:02:52 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:53.128027 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343900c-0a70-4fd2-a754-7e04ab677011 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:53.168739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:53.229929 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343900c-0a70-4fd2-a754-7e04ab677011 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:53.268077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d5fad-209e-4170-b8fd-add7bf37ae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:53.268793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d5fad-209e-4170-b8fd-add7bf37ae24 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:53.269100 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d5fad-209e-4170-b8fd-add7bf37ae24 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:53.269377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d5fad-209e-4170-b8fd-add7bf37ae24 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:53.270071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d5fad-209e-4170-b8fd-add7bf37ae24 None admin] RBAC: Adding query filter params (name=image) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:53.270376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d5fad-209e-4170-b8fd-add7bf37ae24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:53.271727 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d5fad-209e-4170-b8fd-add7bf37ae24 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:53.276960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 505/993] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:53.282938 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935820a-e30e-4e8e-9b7d-4bc32c42b53e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:53.303650 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:53.389670 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935820a-e30e-4e8e-9b7d-4bc32c42b53e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:53.416879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289d11-3710-49e3-9c3c-540721d7bf0d None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:53.417205 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289d11-3710-49e3-9c3c-540721d7bf0d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:53.417491 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289d11-3710-49e3-9c3c-540721d7bf0d None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:53.418870 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 506/994] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:02:53.423937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d22f-a2ca-47ef-b332-0034f6051eef None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:53.424259 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d22f-a2ca-47ef-b332-0034f6051eef None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:53.424523 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45d22f-a2ca-47ef-b332-0034f6051eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:53.426417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6f9db-969e-464f-9e2e-5abda2dfaf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:53.427247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6f9db-969e-464f-9e2e-5abda2dfaf4f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:53.427666 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6f9db-969e-464f-9e2e-5abda2dfaf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:53.428087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6f9db-969e-464f-9e2e-5abda2dfaf4f None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:53.428951 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6f9db-969e-464f-9e2e-5abda2dfaf4f None admin] RBAC: Adding query filter params (type=image) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:53.429423 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6f9db-969e-464f-9e2e-5abda2dfaf4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:53.432235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6f9db-969e-464f-9e2e-5abda2dfaf4f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:53.437666 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 489/995] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:53.442092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5d45d22f-a2ca-47ef-b332-0034f6051eef None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:53.443327 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5d45d22f-a2ca-47ef-b332-0034f6051eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:53.521233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 507/996] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:53.542466 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6f9db-969e-464f-9e2e-5abda2dfaf4f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:53.629385 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:53.652235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6f9db-969e-464f-9e2e-5abda2dfaf4f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:53.688146 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb948fb-fea0-4a97-b596-3dcce9a16550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:53.689351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb948fb-fea0-4a97-b596-3dcce9a16550 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:53.689848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb948fb-fea0-4a97-b596-3dcce9a16550 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:53.690363 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb948fb-fea0-4a97-b596-3dcce9a16550 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:53.691219 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb948fb-fea0-4a97-b596-3dcce9a16550 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:53.692905 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb948fb-fea0-4a97-b596-3dcce9a16550 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-bbb948fb-fea0-4a97-b596-3dcce9a16550 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:53.705028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:53.706543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 10:02:53.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:53.714785 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 490/997] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:53.716357 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45d22f-a2ca-47ef-b332-0034f6051eef None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:53.747585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:53.817131 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45d22f-a2ca-47ef-b332-0034f6051eef None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:53.850779 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2ca8b-7243-46a8-92cf-662cc4915cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:53.851759 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ca8b-7243-46a8-92cf-662cc4915cfa None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:53.852269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ca8b-7243-46a8-92cf-662cc4915cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:53.852774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ca8b-7243-46a8-92cf-662cc4915cfa None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:53.853716 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2ca8b-7243-46a8-92cf-662cc4915cfa None admin] RBAC: Adding query filter params (name=compute) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:53.854230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2ca8b-7243-46a8-92cf-662cc4915cfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:53.855816 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2ca8b-7243-46a8-92cf-662cc4915cfa None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:53.861226 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 508/998] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:53.866948 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb948fb-fea0-4a97-b596-3dcce9a16550 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:53.968212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb948fb-fea0-4a97-b596-3dcce9a16550 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:54.001805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de604-7ba0-4eef-81a5-092afb95df3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:54.002476 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de604-7ba0-4eef-81a5-092afb95df3e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:54.002763 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de604-7ba0-4eef-81a5-092afb95df3e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:54.003064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de604-7ba0-4eef-81a5-092afb95df3e None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:54.003773 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de604-7ba0-4eef-81a5-092afb95df3e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:54.004085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de604-7ba0-4eef-81a5-092afb95df3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:54.005487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de604-7ba0-4eef-81a5-092afb95df3e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:54.010605 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 491/999] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:54.016364 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2ca8b-7243-46a8-92cf-662cc4915cfa None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:54.115236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:54.122161 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2ca8b-7243-46a8-92cf-662cc4915cfa None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:54.161216 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40e1ea-6ca5-49a6-9e08-7b0e215a0e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:54.161969 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40e1ea-6ca5-49a6-9e08-7b0e215a0e29 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:54.162162 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40e1ea-6ca5-49a6-9e08-7b0e215a0e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:54.162440 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40e1ea-6ca5-49a6-9e08-7b0e215a0e29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:54.163224 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40e1ea-6ca5-49a6-9e08-7b0e215a0e29 None admin] RBAC: Adding query filter params (interface=public, service_id=ef98fb00e7fa4e6ebc7c507367843fed, region_id=RegionOne) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:54.163539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40e1ea-6ca5-49a6-9e08-7b0e215a0e29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:54.164924 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40e1ea-6ca5-49a6-9e08-7b0e215a0e29 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:54.170576 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 509/1000] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 10:02:54 2022] GET /identity/v3/endpoints?service_id=ef98fb00e7fa4e6ebc7c507367843fed&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:54.176063 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de604-7ba0-4eef-81a5-092afb95df3e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:54.185704 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:54.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de604-7ba0-4eef-81a5-092afb95df3e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:54.317498 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7da32-da47-498a-ad0c-9cbdd5eb7da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:54.318174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7da32-da47-498a-ad0c-9cbdd5eb7da5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:54.318462 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7da32-da47-498a-ad0c-9cbdd5eb7da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:54.318740 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7da32-da47-498a-ad0c-9cbdd5eb7da5 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:54.319422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7da32-da47-498a-ad0c-9cbdd5eb7da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:54.320791 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7da32-da47-498a-ad0c-9cbdd5eb7da5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:54.327387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 492/1001] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 10:02:54 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:02:55.073000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dce15-bcaf-4a77-a792-5f9bbb566791 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:55.073397 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dce15-bcaf-4a77-a792-5f9bbb566791 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:55.073579 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dce15-bcaf-4a77-a792-5f9bbb566791 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:55.075097 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 510/1002] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:55.080060 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d90c1-0a3a-482b-99c9-75307bec82a4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:55.080361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d90c1-0a3a-482b-99c9-75307bec82a4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:55.080648 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d90c1-0a3a-482b-99c9-75307bec82a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:55.098472 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b48d90c1-0a3a-482b-99c9-75307bec82a4 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:55.099653 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b48d90c1-0a3a-482b-99c9-75307bec82a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:55.170114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:55.177162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 493/1003] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:55.200286 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dce15-bcaf-4a77-a792-5f9bbb566791 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:55.311177 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dce15-bcaf-4a77-a792-5f9bbb566791 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:55.345831 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b90600-9ba6-4589-8ce1-849e4ece92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:55.347147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b90600-9ba6-4589-8ce1-849e4ece92a7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:55.347403 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b90600-9ba6-4589-8ce1-849e4ece92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:55.347676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b90600-9ba6-4589-8ce1-849e4ece92a7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:55.348314 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b90600-9ba6-4589-8ce1-849e4ece92a7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:55.349765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b90600-9ba6-4589-8ce1-849e4ece92a7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-72b90600-9ba6-4589-8ce1-849e4ece92a7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:55.361903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:55.362889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:55.363708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 511/1004] 10.222.0.13 () {56 vars in 1126 bytes} [Tue Jul 5 10:02:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:55.370764 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d90c1-0a3a-482b-99c9-75307bec82a4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:55.490149 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab05b8-29d2-4e61-9d63-4c2270bcc0e9 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:55.490438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab05b8-29d2-4e61-9d63-4c2270bcc0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:55.490712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab05b8-29d2-4e61-9d63-4c2270bcc0e9 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:55.492076 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 512/1005] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:02:55.497230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5602f-0f87-40eb-ac8c-7f7664fb2f79 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:55.497623 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5602f-0f87-40eb-ac8c-7f7664fb2f79 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:55.497918 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5602f-0f87-40eb-ac8c-7f7664fb2f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:55.504324 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d90c1-0a3a-482b-99c9-75307bec82a4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:55.515217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-bfe5602f-0f87-40eb-ac8c-7f7664fb2f79 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:55.516417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bfe5602f-0f87-40eb-ac8c-7f7664fb2f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:55.534346 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:55.541634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fc054-3b42-4d6a-a89e-ae54c1025d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:55.542305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fc054-3b42-4d6a-a89e-ae54c1025d09 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:55.542590 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fc054-3b42-4d6a-a89e-ae54c1025d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:55.542872 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fc054-3b42-4d6a-a89e-ae54c1025d09 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:55.543578 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fc054-3b42-4d6a-a89e-ae54c1025d09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:55.543888 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fc054-3b42-4d6a-a89e-ae54c1025d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:55.545772 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fc054-3b42-4d6a-a89e-ae54c1025d09 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:55.552003 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 494/1006] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 10:02:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:55.557133 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fc054-3b42-4d6a-a89e-ae54c1025d09 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:55.591618 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 513/1007] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:55.615047 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5602f-0f87-40eb-ac8c-7f7664fb2f79 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:55.625199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:55.672239 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fc054-3b42-4d6a-a89e-ae54c1025d09 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:55.709938 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d188f39-9408-4e40-8726-ccd56c7a6631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:55.710609 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188f39-9408-4e40-8726-ccd56c7a6631 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:55.710895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188f39-9408-4e40-8726-ccd56c7a6631 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:55.711174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188f39-9408-4e40-8726-ccd56c7a6631 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:55.711881 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d188f39-9408-4e40-8726-ccd56c7a6631 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:55.712193 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d188f39-9408-4e40-8726-ccd56c7a6631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:55.713589 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d188f39-9408-4e40-8726-ccd56c7a6631 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:55.718648 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 495/1008] 10.222.0.13 () {56 vars in 1122 bytes} [Tue Jul 5 10:02:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:55.724122 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d188f39-9408-4e40-8726-ccd56c7a6631 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:55.730180 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5602f-0f87-40eb-ac8c-7f7664fb2f79 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:55.764155 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2e962-3701-4716-bd76-c11366e975c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:55.764823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2e962-3701-4716-bd76-c11366e975c4 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:55.765137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2e962-3701-4716-bd76-c11366e975c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:55.765415 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2e962-3701-4716-bd76-c11366e975c4 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:55.766129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2e962-3701-4716-bd76-c11366e975c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:55.767491 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2e962-3701-4716-bd76-c11366e975c4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:55.791015 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 514/1009] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:02:55 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:02:55.833446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d188f39-9408-4e40-8726-ccd56c7a6631 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:55.863458 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:55.879928 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e494c-6da1-45e3-9a8b-c380cf7176d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:55.880512 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e494c-6da1-45e3-9a8b-c380cf7176d3 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:55.880797 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e494c-6da1-45e3-9a8b-c380cf7176d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:55.881103 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e494c-6da1-45e3-9a8b-c380cf7176d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:55.881853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e494c-6da1-45e3-9a8b-c380cf7176d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:55.883236 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e494c-6da1-45e3-9a8b-c380cf7176d3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:55.904960 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 496/1010] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 10:02:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:02:56.409569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b49b2-91cd-48b8-acd3-7b29e17111f6 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:56.410077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b49b2-91cd-48b8-acd3-7b29e17111f6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:56.410155 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b49b2-91cd-48b8-acd3-7b29e17111f6 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:56.411635 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 515/1011] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:56.416654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734c12-d637-4621-b0f4-bede7eca5d67 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:56.417092 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734c12-d637-4621-b0f4-bede7eca5d67 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:56.417281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734c12-d637-4621-b0f4-bede7eca5d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:56.434036 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-40734c12-d637-4621-b0f4-bede7eca5d67 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:56.435225 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-40734c12-d637-4621-b0f4-bede7eca5d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:56.510303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 497/1012] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:56 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:56.532864 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b49b2-91cd-48b8-acd3-7b29e17111f6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:56.549395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:56.638116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b49b2-91cd-48b8-acd3-7b29e17111f6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:56.671676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52a4b7-d24c-4ee4-a8a3-f56cc4118b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:56.672468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52a4b7-d24c-4ee4-a8a3-f56cc4118b03 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:56.672754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52a4b7-d24c-4ee4-a8a3-f56cc4118b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:56.673062 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52a4b7-d24c-4ee4-a8a3-f56cc4118b03 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:56.673710 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52a4b7-d24c-4ee4-a8a3-f56cc4118b03 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:56.675633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52a4b7-d24c-4ee4-a8a3-f56cc4118b03 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-aa52a4b7-d24c-4ee4-a8a3-f56cc4118b03 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:56.687283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:56.688240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 10:02:56.689496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:56.693221 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 516/1013] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:02:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:56.694473 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40734c12-d637-4621-b0f4-bede7eca5d67 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:56.795634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40734c12-d637-4621-b0f4-bede7eca5d67 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:56.806776 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:56.832576 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c747a-1320-45ea-b44f-162600401730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:56.833268 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c747a-1320-45ea-b44f-162600401730 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:56.833559 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c747a-1320-45ea-b44f-162600401730 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:56.833840 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c747a-1320-45ea-b44f-162600401730 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:56.834542 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c747a-1320-45ea-b44f-162600401730 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:56.834854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c747a-1320-45ea-b44f-162600401730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:56.836234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c747a-1320-45ea-b44f-162600401730 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:56.845622 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 498/1014] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:56.847125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52a4b7-d24c-4ee4-a8a3-f56cc4118b03 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:56.933604 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:56.957129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52a4b7-d24c-4ee4-a8a3-f56cc4118b03 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:56.991724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39142c93-b7cd-4b31-a068-4539777fe584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:56.992797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39142c93-b7cd-4b31-a068-4539777fe584 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:56.992797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39142c93-b7cd-4b31-a068-4539777fe584 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:56.993513 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39142c93-b7cd-4b31-a068-4539777fe584 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:56.993689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39142c93-b7cd-4b31-a068-4539777fe584 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:56.993968 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39142c93-b7cd-4b31-a068-4539777fe584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:56.995420 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39142c93-b7cd-4b31-a068-4539777fe584 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:57.000835 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 517/1015] 10.222.0.13 () {56 vars in 1112 bytes} [Tue Jul 5 10:02:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:57.006400 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c747a-1320-45ea-b44f-162600401730 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:57.108423 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c747a-1320-45ea-b44f-162600401730 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:57.141716 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b468d-918c-4eba-a060-f37f5d2f2888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:57.142374 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b468d-918c-4eba-a060-f37f5d2f2888 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:57.142658 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b468d-918c-4eba-a060-f37f5d2f2888 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:57.142936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b468d-918c-4eba-a060-f37f5d2f2888 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:57.143731 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b468d-918c-4eba-a060-f37f5d2f2888 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:57.145130 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b468d-918c-4eba-a060-f37f5d2f2888 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:57.164667 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 499/1016] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 10:02:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:02:57.847358 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa0ba6-9442-4186-acb5-f3f1c4e20bdc None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:57.847914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa0ba6-9442-4186-acb5-f3f1c4e20bdc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:57.847914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa0ba6-9442-4186-acb5-f3f1c4e20bdc None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:57.849345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 518/1017] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:57.854380 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731582f3-4851-4c03-9d4c-d8a16a3e1395 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:57.854819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731582f3-4851-4c03-9d4c-d8a16a3e1395 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:57.854976 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731582f3-4851-4c03-9d4c-d8a16a3e1395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:57.872358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-731582f3-4851-4c03-9d4c-d8a16a3e1395 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:57.873582 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-731582f3-4851-4c03-9d4c-d8a16a3e1395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:57.898028 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:57.956538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4400-4ec7-40f1-ba08-571217ff47dd None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:57.956866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4400-4ec7-40f1-ba08-571217ff47dd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:57.957127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4400-4ec7-40f1-ba08-571217ff47dd None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:57.958668 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 519/1018] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:57.960041 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 500/1019] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:57.963310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f98b9-011a-4698-b485-63a2dee20e01 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:57.963599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f98b9-011a-4698-b485-63a2dee20e01 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:57.963877 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f98b9-011a-4698-b485-63a2dee20e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:57.981599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6c8f98b9-011a-4698-b485-63a2dee20e01 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:57.982776 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6c8f98b9-011a-4698-b485-63a2dee20e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:57.983230 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731582f3-4851-4c03-9d4c-d8a16a3e1395 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:58.055160 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 520/1020] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:02:58.078755 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f98b9-011a-4698-b485-63a2dee20e01 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:58.085126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731582f3-4851-4c03-9d4c-d8a16a3e1395 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:58.121982 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d07ae4-cca9-49de-9c4d-4eb640e577df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:58.123051 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d07ae4-cca9-49de-9c4d-4eb640e577df None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:58.123592 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d07ae4-cca9-49de-9c4d-4eb640e577df None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:58.124038 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d07ae4-cca9-49de-9c4d-4eb640e577df None admin] PATH_INFO: `/v3/services/image` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:58.124830 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d07ae4-cca9-49de-9c4d-4eb640e577df None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:58.126357 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d07ae4-cca9-49de-9c4d-4eb640e577df None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-76d07ae4-cca9-49de-9c4d-4eb640e577df None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:58.138949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:58.140114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 10:02:58.141143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:02:58.143182 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 501/1021] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Jul 5 10:02:57 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:58.149466 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d07ae4-cca9-49de-9c4d-4eb640e577df None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:58.153742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:58.175937 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:58.186719 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f98b9-011a-4698-b485-63a2dee20e01 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:58.220124 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d414c-02af-45a3-b730-5032ebd1842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:58.220931 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d414c-02af-45a3-b730-5032ebd1842e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:58.221221 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d414c-02af-45a3-b730-5032ebd1842e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:58.221512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d414c-02af-45a3-b730-5032ebd1842e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:58.222670 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d414c-02af-45a3-b730-5032ebd1842e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:58.224085 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d414c-02af-45a3-b730-5032ebd1842e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:58.225728 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 521/1022] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:58.231271 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d414c-02af-45a3-b730-5032ebd1842e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:58.262444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d07ae4-cca9-49de-9c4d-4eb640e577df None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:58.304995 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9d6a3-3c8a-4b15-84ea-d1c46f483e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:58.305675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9d6a3-3c8a-4b15-84ea-d1c46f483e82 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:58.305957 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9d6a3-3c8a-4b15-84ea-d1c46f483e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:58.306238 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9d6a3-3c8a-4b15-84ea-d1c46f483e82 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:58.306944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9d6a3-3c8a-4b15-84ea-d1c46f483e82 None admin] RBAC: Adding query filter params (name=image) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:58.307258 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9d6a3-3c8a-4b15-84ea-d1c46f483e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:58.308641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9d6a3-3c8a-4b15-84ea-d1c46f483e82 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:58.315168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 502/1023] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:58.319594 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9d6a3-3c8a-4b15-84ea-d1c46f483e82 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:58.345149 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d414c-02af-45a3-b730-5032ebd1842e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:58.383355 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf85db-de39-4c15-a46c-e1e2d33e729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:58.383934 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf85db-de39-4c15-a46c-e1e2d33e729a None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:58.384218 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf85db-de39-4c15-a46c-e1e2d33e729a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:58.384494 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf85db-de39-4c15-a46c-e1e2d33e729a None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:58.385225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf85db-de39-4c15-a46c-e1e2d33e729a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:58.386636 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf85db-de39-4c15-a46c-e1e2d33e729a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:58.398074 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:58.412420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:58.414718 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 522/1024] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:02:58 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:02:58.430046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9d6a3-3c8a-4b15-84ea-d1c46f483e82 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:58.468163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd9424-89fb-4599-922c-e12eec04c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:58.468854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd9424-89fb-4599-922c-e12eec04c0ec None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:58.469170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd9424-89fb-4599-922c-e12eec04c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:58.469449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd9424-89fb-4599-922c-e12eec04c0ec None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:58.470175 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd9424-89fb-4599-922c-e12eec04c0ec None admin] RBAC: Adding query filter params (type=image) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:58.470486 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd9424-89fb-4599-922c-e12eec04c0ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:58.472482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd9424-89fb-4599-922c-e12eec04c0ec None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:58.483207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 503/1025] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:58.484762 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf85db-de39-4c15-a46c-e1e2d33e729a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:58.603341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf85db-de39-4c15-a46c-e1e2d33e729a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:58.651239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41515a72-bd52-471c-840b-5d64c2ea70f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:58.651821 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41515a72-bd52-471c-840b-5d64c2ea70f7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:58.652106 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41515a72-bd52-471c-840b-5d64c2ea70f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:58.652384 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41515a72-bd52-471c-840b-5d64c2ea70f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:58.653200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41515a72-bd52-471c-840b-5d64c2ea70f7 None admin] RBAC: Adding query filter params (interface=public, service_id=1d5aaae4385546088098db7c6b386181, region_id=RegionOne) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:58.653514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41515a72-bd52-471c-840b-5d64c2ea70f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:58.654877 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41515a72-bd52-471c-840b-5d64c2ea70f7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:58.660734 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 523/1026] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 10:02:58 2022] GET /identity/v3/endpoints?service_id=1d5aaae4385546088098db7c6b386181&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:02:58.666394 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd9424-89fb-4599-922c-e12eec04c0ec None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:58.767146 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd9424-89fb-4599-922c-e12eec04c0ec None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:58.801386 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31897aa-08a7-4480-8cef-0060a7bb8cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:58.802056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31897aa-08a7-4480-8cef-0060a7bb8cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:58.802339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31897aa-08a7-4480-8cef-0060a7bb8cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:58.802615 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31897aa-08a7-4480-8cef-0060a7bb8cd6 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:58.803291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31897aa-08a7-4480-8cef-0060a7bb8cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:58.804658 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31897aa-08a7-4480-8cef-0060a7bb8cd6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:58.816972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 504/1027] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 10:02:58 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:02:59.297284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5301-064f-47b8-ad96-348546a904b9 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:59.297714 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5301-064f-47b8-ad96-348546a904b9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:59.297907 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5301-064f-47b8-ad96-348546a904b9 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:59.299373 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 524/1028] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:02:59.304337 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f8910-f414-467d-8bca-a7462201c811 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:59.304717 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f8910-f414-467d-8bca-a7462201c811 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:59.304923 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f8910-f414-467d-8bca-a7462201c811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:59.322663 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-156f8910-f414-467d-8bca-a7462201c811 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:02:59.323898 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-156f8910-f414-467d-8bca-a7462201c811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:02:59.332289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:59.391727 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 505/1029] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:02:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:02:59.415317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f5301-064f-47b8-ad96-348546a904b9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:59.474810 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:59.523010 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f5301-064f-47b8-ad96-348546a904b9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:59.560276 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fa5ec-a1b1-4800-998e-5796b68dfe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:59.561063 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa5ec-a1b1-4800-998e-5796b68dfe23 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:59.561352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa5ec-a1b1-4800-998e-5796b68dfe23 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:59.561626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa5ec-a1b1-4800-998e-5796b68dfe23 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:59.573752 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fa5ec-a1b1-4800-998e-5796b68dfe23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0b2fa5ec-a1b1-4800-998e-5796b68dfe23 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:02:59.582280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:59.583253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:59.589307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 525/1030] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 10:02:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:02:59.591557 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f8910-f414-467d-8bca-a7462201c811 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:59.692409 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f8910-f414-467d-8bca-a7462201c811 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:59.726478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8d6bf-404c-4711-90bb-209b91b1442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:59.727143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8d6bf-404c-4711-90bb-209b91b1442c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:59.727428 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8d6bf-404c-4711-90bb-209b91b1442c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:59.727706 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8d6bf-404c-4711-90bb-209b91b1442c None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:59.728445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8d6bf-404c-4711-90bb-209b91b1442c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:02:59.728756 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8d6bf-404c-4711-90bb-209b91b1442c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:59.730155 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8d6bf-404c-4711-90bb-209b91b1442c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:59.738898 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 506/1031] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 10:02:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:02:59.744297 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fa5ec-a1b1-4800-998e-5796b68dfe23 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:59.843276 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fa5ec-a1b1-4800-998e-5796b68dfe23 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:02:59.860134 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:02:59.880195 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7a3ce-d169-4f15-b86b-ab73fa9eea2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:02:59.881033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7a3ce-d169-4f15-b86b-ab73fa9eea2f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:02:59.881322 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7a3ce-d169-4f15-b86b-ab73fa9eea2f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:02:59.881600 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7a3ce-d169-4f15-b86b-ab73fa9eea2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:02:59.892230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7a3ce-d169-4f15-b86b-ab73fa9eea2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:02:59.893670 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7a3ce-d169-4f15-b86b-ab73fa9eea2f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-21a7a3ce-d169-4f15-b86b-ab73fa9eea2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:02:59.911782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:02:59.912753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:02:59.914050 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:02:59.914050 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:02:59.914050 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:02:59.914050 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:02:59.914688 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 526/1032] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:02:59.921467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8d6bf-404c-4711-90bb-209b91b1442c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:02:59.927255 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:00.029197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8d6bf-404c-4711-90bb-209b91b1442c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:00.062974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36745338-704a-46a2-aac5-9a330f65789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:00.063640 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36745338-704a-46a2-aac5-9a330f65789f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:00.063927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36745338-704a-46a2-aac5-9a330f65789f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:00.064207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36745338-704a-46a2-aac5-9a330f65789f None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:00.064951 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36745338-704a-46a2-aac5-9a330f65789f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:00.065915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36745338-704a-46a2-aac5-9a330f65789f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:00.067292 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36745338-704a-46a2-aac5-9a330f65789f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:00.083609 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 507/1033] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:00.084854 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7a3ce-d169-4f15-b86b-ab73fa9eea2f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:00.185113 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7a3ce-d169-4f15-b86b-ab73fa9eea2f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:00.219112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18896b-4c9a-4723-bd6d-caf785cfe455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:00.219904 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18896b-4c9a-4723-bd6d-caf785cfe455 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:00.220189 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18896b-4c9a-4723-bd6d-caf785cfe455 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:00.220466 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18896b-4c9a-4723-bd6d-caf785cfe455 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:00.227395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18896b-4c9a-4723-bd6d-caf785cfe455 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:00.228812 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18896b-4c9a-4723-bd6d-caf785cfe455 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-8d18896b-4c9a-4723-bd6d-caf785cfe455 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:03:00.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:00.243789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:00.244720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:00.244720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:00.244720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:03:00.244720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:03:00.244720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:03:00.244720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:03:00.244720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:03:00.244720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:03:00.244720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:03:00.244720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:00.248769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 527/1034] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 10:03:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:00.249994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36745338-704a-46a2-aac5-9a330f65789f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:00.317927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:00.357238 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36745338-704a-46a2-aac5-9a330f65789f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:00.391523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b922-8366-4d4a-a6ea-085327cf61bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:00.392224 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b922-8366-4d4a-a6ea-085327cf61bc None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:00.392512 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b922-8366-4d4a-a6ea-085327cf61bc None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:00.392791 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b922-8366-4d4a-a6ea-085327cf61bc None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:00.394299 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27b922-8366-4d4a-a6ea-085327cf61bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:00.394613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27b922-8366-4d4a-a6ea-085327cf61bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:00.396049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27b922-8366-4d4a-a6ea-085327cf61bc None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:00.417564 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 508/1035] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 10:03:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:00.419030 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18896b-4c9a-4723-bd6d-caf785cfe455 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:00.449210 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:00.506498 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795702d-b1d2-4f17-aa8f-ae9ebcaa52c0 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:00.506820 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795702d-b1d2-4f17-aa8f-ae9ebcaa52c0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:00.507070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795702d-b1d2-4f17-aa8f-ae9ebcaa52c0 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:00.508934 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 509/1036] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:00.513463 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596510a-3c66-4c5f-9d93-6358f81d0fe7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:00.513754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596510a-3c66-4c5f-9d93-6358f81d0fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:00.514031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596510a-3c66-4c5f-9d93-6358f81d0fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:00.525219 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18896b-4c9a-4723-bd6d-caf785cfe455 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:00.531146 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e596510a-3c66-4c5f-9d93-6358f81d0fe7 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:00.532332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e596510a-3c66-4c5f-9d93-6358f81d0fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:00.561295 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7266e6-ed89-4f67-8edb-02bee6b43a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:00.561948 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7266e6-ed89-4f67-8edb-02bee6b43a1c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:00.562230 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7266e6-ed89-4f67-8edb-02bee6b43a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:00.562511 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7266e6-ed89-4f67-8edb-02bee6b43a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:00.605154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 510/1037] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:03:00.628921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596510a-3c66-4c5f-9d93-6358f81d0fe7 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:00.633392 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7266e6-ed89-4f67-8edb-02bee6b43a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:00.634859 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7266e6-ed89-4f67-8edb-02bee6b43a1c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:00.665060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:00.685435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:00.735457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596510a-3c66-4c5f-9d93-6358f81d0fe7 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:00.742038 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 528/1038] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:03:00.747624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7266e6-ed89-4f67-8edb-02bee6b43a1c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:00.772212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f881b9a-3753-4dbf-90a2-94b3bb6d394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:00.773035 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881b9a-3753-4dbf-90a2-94b3bb6d394b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:00.773320 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881b9a-3753-4dbf-90a2-94b3bb6d394b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:00.773594 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881b9a-3753-4dbf-90a2-94b3bb6d394b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:00.774999 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f881b9a-3753-4dbf-90a2-94b3bb6d394b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:00.776421 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f881b9a-3753-4dbf-90a2-94b3bb6d394b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:00.778582 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 511/1039] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:00.785158 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f881b9a-3753-4dbf-90a2-94b3bb6d394b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:00.851105 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7266e6-ed89-4f67-8edb-02bee6b43a1c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:00.877029 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:00.884869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73ea6d-2ce6-4699-8829-77db720eada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:00.885692 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73ea6d-2ce6-4699-8829-77db720eada0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:00.885978 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73ea6d-2ce6-4699-8829-77db720eada0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:00.887256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73ea6d-2ce6-4699-8829-77db720eada0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:00.888511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f881b9a-3753-4dbf-90a2-94b3bb6d394b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:00.897135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73ea6d-2ce6-4699-8829-77db720eada0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:00.898578 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73ea6d-2ce6-4699-8829-77db720eada0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:00.908001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-8a73ea6d-2ce6-4699-8829-77db720eada0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:03:00.916869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:00.917873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:00.918849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:03:00.918849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:03:00.918849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:00.918849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:00.918849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 529/1040] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:03:00.919503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f4fad-00a3-4e0d-8a08-cde9341c7fc2 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:00.920019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f4fad-00a3-4e0d-8a08-cde9341c7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:00.920297 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f4fad-00a3-4e0d-8a08-cde9341c7fc2 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:00.921708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 530/1041] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:00.926731 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cf034-6e3f-457a-bba9-a1d40c4c7367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:00.926883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f4fad-00a3-4e0d-8a08-cde9341c7fc2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:00.927408 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cf034-6e3f-457a-bba9-a1d40c4c7367 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:00.927691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cf034-6e3f-457a-bba9-a1d40c4c7367 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:00.927966 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cf034-6e3f-457a-bba9-a1d40c4c7367 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:00.928681 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cf034-6e3f-457a-bba9-a1d40c4c7367 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:00.930169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cf034-6e3f-457a-bba9-a1d40c4c7367 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:00.949788 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 512/1042] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:03:00 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:03:00.951022 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e42e9e-52b3-4a60-8576-ef2d17e0bb15 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:00.951300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e42e9e-52b3-4a60-8576-ef2d17e0bb15 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:00.951595 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e42e9e-52b3-4a60-8576-ef2d17e0bb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:00.968850 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d1e42e9e-52b3-4a60-8576-ef2d17e0bb15 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:00.970107 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d1e42e9e-52b3-4a60-8576-ef2d17e0bb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:01.048792 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 513/1043] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:01.064596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f4fad-00a3-4e0d-8a08-cde9341c7fc2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:01.072113 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e42e9e-52b3-4a60-8576-ef2d17e0bb15 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:01.109351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04658240-22d5-4709-9fd7-e1d83a4d4174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:01.109351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04658240-22d5-4709-9fd7-e1d83a4d4174 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:01.109666 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04658240-22d5-4709-9fd7-e1d83a4d4174 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:01.109882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04658240-22d5-4709-9fd7-e1d83a4d4174 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:01.111046 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04658240-22d5-4709-9fd7-e1d83a4d4174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:01.111046 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04658240-22d5-4709-9fd7-e1d83a4d4174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:01.112718 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04658240-22d5-4709-9fd7-e1d83a4d4174 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:01.125727 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 531/1044] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:01.132832 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04658240-22d5-4709-9fd7-e1d83a4d4174 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:01.179350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:01.184540 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e42e9e-52b3-4a60-8576-ef2d17e0bb15 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:01.193048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:01.221371 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13827d8-4b17-47e0-a7f5-e3a087603fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:01.222209 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13827d8-4b17-47e0-a7f5-e3a087603fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:01.222494 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13827d8-4b17-47e0-a7f5-e3a087603fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:01.222773 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13827d8-4b17-47e0-a7f5-e3a087603fe5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:01.223429 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13827d8-4b17-47e0-a7f5-e3a087603fe5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:01.224801 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13827d8-4b17-47e0-a7f5-e3a087603fe5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d13827d8-4b17-47e0-a7f5-e3a087603fe5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:01.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:01.237908 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:03:01.238798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 514/1045] 10.222.0.13 () {56 vars in 1105 bytes} [Tue Jul 5 10:03:01 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:03:01.244189 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13827d8-4b17-47e0-a7f5-e3a087603fe5 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:01.252549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04658240-22d5-4709-9fd7-e1d83a4d4174 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:01.288712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ddb18-5736-44ba-b06f-ea1fd8945d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:01.289780 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ddb18-5736-44ba-b06f-ea1fd8945d8b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:01.290066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ddb18-5736-44ba-b06f-ea1fd8945d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:01.290345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ddb18-5736-44ba-b06f-ea1fd8945d8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:01.297922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ddb18-5736-44ba-b06f-ea1fd8945d8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:01.299426 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ddb18-5736-44ba-b06f-ea1fd8945d8b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-b66ddb18-5736-44ba-b06f-ea1fd8945d8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:03:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:01.316524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:01.317653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:03:01.317653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:03:01.317653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:03:01.317653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:03:01.317653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:03:01.317653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:03:01.317653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:03:01.317653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:01.317653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 532/1046] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:01.322085 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ddb18-5736-44ba-b06f-ea1fd8945d8b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:01.356088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13827d8-4b17-47e0-a7f5-e3a087603fe5 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:01.391367 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc982d-bada-46ec-95e8-9dd09e6db68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:01.392027 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc982d-bada-46ec-95e8-9dd09e6db68d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:01.392374 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc982d-bada-46ec-95e8-9dd09e6db68d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:01.392657 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc982d-bada-46ec-95e8-9dd09e6db68d None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:01.393436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc982d-bada-46ec-95e8-9dd09e6db68d None admin] RBAC: Adding query filter params (name=image) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:01.393737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc982d-bada-46ec-95e8-9dd09e6db68d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:01.395102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc982d-bada-46ec-95e8-9dd09e6db68d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:01.400171 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 515/1047] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:01.405701 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc982d-bada-46ec-95e8-9dd09e6db68d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:01.430513 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:01.434439 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ddb18-5736-44ba-b06f-ea1fd8945d8b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:01.443818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:01.474664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b27855-30c0-4dfe-ae89-b67e5853f618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:01.475633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b27855-30c0-4dfe-ae89-b67e5853f618 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:01.476141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b27855-30c0-4dfe-ae89-b67e5853f618 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:01.476423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b27855-30c0-4dfe-ae89-b67e5853f618 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:01.477240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b27855-30c0-4dfe-ae89-b67e5853f618 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:01.477556 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b27855-30c0-4dfe-ae89-b67e5853f618 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:01.479387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b27855-30c0-4dfe-ae89-b67e5853f618 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:01.491544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 533/1048] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:01.497350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b27855-30c0-4dfe-ae89-b67e5853f618 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:01.517335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc982d-bada-46ec-95e8-9dd09e6db68d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:01.554983 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01057b-6906-46a2-b2e7-4390ef14d38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:01.555574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01057b-6906-46a2-b2e7-4390ef14d38f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:01.555867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01057b-6906-46a2-b2e7-4390ef14d38f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:01.556147 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01057b-6906-46a2-b2e7-4390ef14d38f None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:01.556861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01057b-6906-46a2-b2e7-4390ef14d38f None admin] RBAC: Adding query filter params (type=image) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:01.557199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01057b-6906-46a2-b2e7-4390ef14d38f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:01.558576 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01057b-6906-46a2-b2e7-4390ef14d38f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:01.563615 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 516/1049] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:01.569958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01057b-6906-46a2-b2e7-4390ef14d38f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:01.605684 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b27855-30c0-4dfe-ae89-b67e5853f618 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:01.640674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0a8f-ee13-49dd-b0d4-c1eb74a24b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:01.641362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0a8f-ee13-49dd-b0d4-c1eb74a24b97 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:01.641662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0a8f-ee13-49dd-b0d4-c1eb74a24b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:01.641927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0a8f-ee13-49dd-b0d4-c1eb74a24b97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:01.642751 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0a8f-ee13-49dd-b0d4-c1eb74a24b97 None admin] RBAC: Adding query filter params (role.id=008ab9f39a224eb08f13bc0c9c574e1c, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=1ff81129f179478d901b590a5be64f38) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:01.643063 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0a8f-ee13-49dd-b0d4-c1eb74a24b97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:01.644536 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0a8f-ee13-49dd-b0d4-c1eb74a24b97 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:01.650384 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 534/1050] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:03:01 2022] GET /identity/v3/role_assignments?user.id=1ff81129f179478d901b590a5be64f38&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=008ab9f39a224eb08f13bc0c9c574e1c => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:01.674176 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:01.679808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01057b-6906-46a2-b2e7-4390ef14d38f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:01.719237 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445fb64-d040-4a9e-965e-bf0da8f9a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:01.719925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445fb64-d040-4a9e-965e-bf0da8f9a236 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:01.720211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445fb64-d040-4a9e-965e-bf0da8f9a236 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:01.720545 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445fb64-d040-4a9e-965e-bf0da8f9a236 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:01.721340 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445fb64-d040-4a9e-965e-bf0da8f9a236 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:01.723270 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445fb64-d040-4a9e-965e-bf0da8f9a236 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:01.752939 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 517/1051] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 10:03:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:03:03.025356 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d19bb3-c43c-496b-a90b-1a689717af8d None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:03.025878 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d19bb3-c43c-496b-a90b-1a689717af8d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:03.025955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d19bb3-c43c-496b-a90b-1a689717af8d None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:03.027403 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 535/1052] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:03.032277 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce517-ab2b-4576-85b2-5c28a6787a79 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:03.032668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce517-ab2b-4576-85b2-5c28a6787a79 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:03.032828 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce517-ab2b-4576-85b2-5c28a6787a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:03.049343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-883ce517-ab2b-4576-85b2-5c28a6787a79 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:03.051032 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-883ce517-ab2b-4576-85b2-5c28a6787a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:03.121846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 518/1053] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:03.144505 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d19bb3-c43c-496b-a90b-1a689717af8d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:03.170477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:03.248386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d19bb3-c43c-496b-a90b-1a689717af8d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:03.280999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60606d-036a-40c5-b3cc-18738f131f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:03.281702 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60606d-036a-40c5-b3cc-18738f131f41 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:03.281984 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60606d-036a-40c5-b3cc-18738f131f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:03.282259 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60606d-036a-40c5-b3cc-18738f131f41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:03.302423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60606d-036a-40c5-b3cc-18738f131f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ca60606d-036a-40c5-b3cc-18738f131f41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:03:03.310067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:03.311020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:03.311860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:03.319184 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 536/1054] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:03:03.319320 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ce517-ab2b-4576-85b2-5c28a6787a79 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:03.398909 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:03.420525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ce517-ab2b-4576-85b2-5c28a6787a79 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:03.454123 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d4326-63fe-4939-8abb-535cc8e18be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:03.454801 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d4326-63fe-4939-8abb-535cc8e18be3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:03.455087 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d4326-63fe-4939-8abb-535cc8e18be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:03.455367 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d4326-63fe-4939-8abb-535cc8e18be3 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:03.457026 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d4326-63fe-4939-8abb-535cc8e18be3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:03.457343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d4326-63fe-4939-8abb-535cc8e18be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:03.458710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d4326-63fe-4939-8abb-535cc8e18be3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:03.472127 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 519/1055] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:03.473541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60606d-036a-40c5-b3cc-18738f131f41 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:03.558019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:03.574758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60606d-036a-40c5-b3cc-18738f131f41 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:03.609014 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61093c32-88cc-4684-bbb2-279f302fff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:03.609878 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093c32-88cc-4684-bbb2-279f302fff4b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:03.610165 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093c32-88cc-4684-bbb2-279f302fff4b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:03.610444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093c32-88cc-4684-bbb2-279f302fff4b None admin] PATH_INFO: `/v3/users/3331dd3cd6d84a039b3175612f02fbd9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:03.623446 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61093c32-88cc-4684-bbb2-279f302fff4b None admin] RBAC: Authorizing `identity:get_user(user_id=3331dd3cd6d84a039b3175612f02fbd9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:03.624913 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61093c32-88cc-4684-bbb2-279f302fff4b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:03.631248 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 537/1056] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:03 2022] GET /identity/v3/users/3331dd3cd6d84a039b3175612f02fbd9 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:03.632445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d4326-63fe-4939-8abb-535cc8e18be3 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:03.672168 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae06ae-f529-4842-841b-465d60623b11 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:03.672510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae06ae-f529-4842-841b-465d60623b11 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:03.672738 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae06ae-f529-4842-841b-465d60623b11 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:03.674138 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 538/1057] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:03:03.679258 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474698ce-f7a0-473b-a50e-c0d2102d8868 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:03.679543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474698ce-f7a0-473b-a50e-c0d2102d8868 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:03.679822 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474698ce-f7a0-473b-a50e-c0d2102d8868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:03.696609 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-474698ce-f7a0-473b-a50e-c0d2102d8868 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:03.697832 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-474698ce-f7a0-473b-a50e-c0d2102d8868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:03.739143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d4326-63fe-4939-8abb-535cc8e18be3 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:03.767251 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 539/1058] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:03:03.774614 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e05a49-ac4c-44f9-b28c-97d1f6aa664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:03.775272 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e05a49-ac4c-44f9-b28c-97d1f6aa664e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:03.775560 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e05a49-ac4c-44f9-b28c-97d1f6aa664e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:03.775841 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e05a49-ac4c-44f9-b28c-97d1f6aa664e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:03.788341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:03.791034 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474698ce-f7a0-473b-a50e-c0d2102d8868 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:03.848251 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e05a49-ac4c-44f9-b28c-97d1f6aa664e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:03.849658 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e05a49-ac4c-44f9-b28c-97d1f6aa664e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:03.861016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:03.890263 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474698ce-f7a0-473b-a50e-c0d2102d8868 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:03.923809 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503828c7-7041-46c0-adc5-000631fff87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:03.925164 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503828c7-7041-46c0-adc5-000631fff87b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:03.925451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503828c7-7041-46c0-adc5-000631fff87b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:03.925727 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503828c7-7041-46c0-adc5-000631fff87b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:03.935779 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503828c7-7041-46c0-adc5-000631fff87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-503828c7-7041-46c0-adc5-000631fff87b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:03:03.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:03.944923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:03.945765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 540/1059] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 10:03:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:03:03.951317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 520/1060] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 10:03:03.951404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3ee99-0dce-4004-8ce1-b2779c837518 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:03.951404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3ee99-0dce-4004-8ce1-b2779c837518 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:03.951404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3ee99-0dce-4004-8ce1-b2779c837518 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:03.951404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 541/1061] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:03.951651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e05a49-ac4c-44f9-b28c-97d1f6aa664e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:03.952450 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3ee99-0dce-4004-8ce1-b2779c837518 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:03.993828 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:04.051257 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e05a49-ac4c-44f9-b28c-97d1f6aa664e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:04.055710 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3ee99-0dce-4004-8ce1-b2779c837518 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:04.083688 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:04.085218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3217b-20c5-436b-a6d0-7698bbd1093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:04.085937 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3217b-20c5-436b-a6d0-7698bbd1093c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:04.086223 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3217b-20c5-436b-a6d0-7698bbd1093c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:04.086503 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3217b-20c5-436b-a6d0-7698bbd1093c None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:04.087258 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3217b-20c5-436b-a6d0-7698bbd1093c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:04.087568 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3217b-20c5-436b-a6d0-7698bbd1093c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:04.088976 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3217b-20c5-436b-a6d0-7698bbd1093c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:04.089490 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540500a-679a-4d26-a0ed-48a01037473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:04.090523 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540500a-679a-4d26-a0ed-48a01037473b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:04.090813 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540500a-679a-4d26-a0ed-48a01037473b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:04.091418 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540500a-679a-4d26-a0ed-48a01037473b None admin] PATH_INFO: `/v3/projects/60573cc4e1444232b83c0719437d6e20` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:04.092662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540500a-679a-4d26-a0ed-48a01037473b None admin] RBAC: Authorizing `identity:get_project(project_id=60573cc4e1444232b83c0719437d6e20)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:04.094123 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540500a-679a-4d26-a0ed-48a01037473b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:04.095969 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 542/1062] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:03 2022] GET /identity/v3/projects/60573cc4e1444232b83c0719437d6e20 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:04.097475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8165a12-45bf-4f23-abf1-868bda40791e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:04.097580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 521/1063] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 10:03:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:04.097770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8165a12-45bf-4f23-abf1-868bda40791e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:04.098053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8165a12-45bf-4f23-abf1-868bda40791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:04.102321 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3217b-20c5-436b-a6d0-7698bbd1093c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:04.116959 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c8165a12-45bf-4f23-abf1-868bda40791e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:04.118131 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c8165a12-45bf-4f23-abf1-868bda40791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:04.182181 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 543/1064] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:04.183055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8165a12-45bf-4f23-abf1-868bda40791e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:04.201071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3217b-20c5-436b-a6d0-7698bbd1093c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:04.203696 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:04.237803 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921f2ef-6054-4373-91d2-4b0417cc3822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:04.238449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921f2ef-6054-4373-91d2-4b0417cc3822 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:04.238729 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921f2ef-6054-4373-91d2-4b0417cc3822 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:04.239002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921f2ef-6054-4373-91d2-4b0417cc3822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:04.239822 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921f2ef-6054-4373-91d2-4b0417cc3822 None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=60573cc4e1444232b83c0719437d6e20, user.id=3331dd3cd6d84a039b3175612f02fbd9) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:04.240128 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921f2ef-6054-4373-91d2-4b0417cc3822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:04.241598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921f2ef-6054-4373-91d2-4b0417cc3822 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:04.247020 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 522/1065] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:03:04 2022] GET /identity/v3/role_assignments?user.id=3331dd3cd6d84a039b3175612f02fbd9&scope.project.id=60573cc4e1444232b83c0719437d6e20&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:04.247806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921f2ef-6054-4373-91d2-4b0417cc3822 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:04.305365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8165a12-45bf-4f23-abf1-868bda40791e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:04.336363 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:04.342906 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e2084-ef55-44e8-9c58-1a7e70429287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:04.343728 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e2084-ef55-44e8-9c58-1a7e70429287 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:04.344015 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e2084-ef55-44e8-9c58-1a7e70429287 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:04.344297 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e2084-ef55-44e8-9c58-1a7e70429287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:04.356341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e2084-ef55-44e8-9c58-1a7e70429287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:04.357770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e2084-ef55-44e8-9c58-1a7e70429287 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:04.365133 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921f2ef-6054-4373-91d2-4b0417cc3822 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c37e2084-ef55-44e8-9c58-1a7e70429287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:03:04.376349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:04.377472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:04.378350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:03:04.378350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:03:04.378350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:04.378350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:04.378350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 544/1066] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:04.383736 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e2084-ef55-44e8-9c58-1a7e70429287 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:04.405446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37371-da33-4ed0-8a78-a28d315aa125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:04.406104 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37371-da33-4ed0-8a78-a28d315aa125 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:04.406410 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37371-da33-4ed0-8a78-a28d315aa125 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:04.406687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37371-da33-4ed0-8a78-a28d315aa125 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:04.446394 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:04.489022 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac37371-da33-4ed0-8a78-a28d315aa125 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:04.491211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac37371-da33-4ed0-8a78-a28d315aa125 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:04.492974 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e2084-ef55-44e8-9c58-1a7e70429287 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:04.529909 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75043bb-e991-452d-9347-1d9dc3a19977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:04.530589 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75043bb-e991-452d-9347-1d9dc3a19977 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:04.530930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75043bb-e991-452d-9347-1d9dc3a19977 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:04.531216 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75043bb-e991-452d-9347-1d9dc3a19977 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:04.531939 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75043bb-e991-452d-9347-1d9dc3a19977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:04.532301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75043bb-e991-452d-9347-1d9dc3a19977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:04.533735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75043bb-e991-452d-9347-1d9dc3a19977 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:04.546976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 545/1067] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:04.552496 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75043bb-e991-452d-9347-1d9dc3a19977 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:04.600938 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 523/1068] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:03:04.606446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37371-da33-4ed0-8a78-a28d315aa125 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:04.608384 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:04.668883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75043bb-e991-452d-9347-1d9dc3a19977 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:04.675578 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:04.704787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69280037-88c8-4c1a-9660-d742e4280e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:04.705618 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280037-88c8-4c1a-9660-d742e4280e90 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:04.706449 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280037-88c8-4c1a-9660-d742e4280e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:04.706814 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280037-88c8-4c1a-9660-d742e4280e90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:04.714440 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69280037-88c8-4c1a-9660-d742e4280e90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:04.714687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37371-da33-4ed0-8a78-a28d315aa125 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:04.715894 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69280037-88c8-4c1a-9660-d742e4280e90 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-69280037-88c8-4c1a-9660-d742e4280e90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:03:04.730659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:04.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:04.733033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:04.733033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:04.733033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:03:04.733033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:03:04.733033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:03:04.733033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:03:04.733033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:03:04.733033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:03:04.733033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:03:04.733033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:04.736627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 546/1069] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 10:03:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:03:04.737571 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69280037-88c8-4c1a-9660-d742e4280e90 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:04.755554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff5aab-4732-4997-9ae4-7c57fa93054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:04.756352 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5aab-4732-4997-9ae4-7c57fa93054c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:04.756631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5aab-4732-4997-9ae4-7c57fa93054c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:04.756941 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5aab-4732-4997-9ae4-7c57fa93054c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:04.769298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff5aab-4732-4997-9ae4-7c57fa93054c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:04.770736 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff5aab-4732-4997-9ae4-7c57fa93054c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-22ff5aab-4732-4997-9ae4-7c57fa93054c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:03:04.789445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:04.790343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:04.791235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:03:04.791235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:03:04.791235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:04.791235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:03:04.796145 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 524/1070] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:03:04.796995 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff5aab-4732-4997-9ae4-7c57fa93054c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:04.843095 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69280037-88c8-4c1a-9660-d742e4280e90 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:04.844759 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:04.883401 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d069cea-e280-4290-8c9c-bfd5b977d612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:04.883986 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d069cea-e280-4290-8c9c-bfd5b977d612 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:04.884370 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d069cea-e280-4290-8c9c-bfd5b977d612 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:04.884651 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d069cea-e280-4290-8c9c-bfd5b977d612 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:04.885621 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d069cea-e280-4290-8c9c-bfd5b977d612 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:04.885930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d069cea-e280-4290-8c9c-bfd5b977d612 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:04.887366 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d069cea-e280-4290-8c9c-bfd5b977d612 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:04.900307 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff5aab-4732-4997-9ae4-7c57fa93054c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:04.910203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 547/1071] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 10:03:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:04.912033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d069cea-e280-4290-8c9c-bfd5b977d612 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:04.928035 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:04.943905 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd83f7a-67a0-45e8-9f4e-7a1239fba665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:04.944571 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd83f7a-67a0-45e8-9f4e-7a1239fba665 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:04.944851 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd83f7a-67a0-45e8-9f4e-7a1239fba665 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:04.945156 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd83f7a-67a0-45e8-9f4e-7a1239fba665 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:04.945866 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd83f7a-67a0-45e8-9f4e-7a1239fba665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:04.946174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd83f7a-67a0-45e8-9f4e-7a1239fba665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:04.947529 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd83f7a-67a0-45e8-9f4e-7a1239fba665 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:04.961292 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 525/1072] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:05.024847 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d069cea-e280-4290-8c9c-bfd5b977d612 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:05.063127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adad8f4-ff96-4b23-b0a0-ebf35b1af5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:05.064636 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad8f4-ff96-4b23-b0a0-ebf35b1af5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:05.065739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad8f4-ff96-4b23-b0a0-ebf35b1af5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:05.066169 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad8f4-ff96-4b23-b0a0-ebf35b1af5c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:05.077692 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adad8f4-ff96-4b23-b0a0-ebf35b1af5c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:05.079396 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adad8f4-ff96-4b23-b0a0-ebf35b1af5c9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-1adad8f4-ff96-4b23-b0a0-ebf35b1af5c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:03:05.098400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:05.099441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:05.100345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:03:05.100345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:03:05.100345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:05.100345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:05.104401 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 548/1073] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:03:05.106282 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd83f7a-67a0-45e8-9f4e-7a1239fba665 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:05.213523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd83f7a-67a0-45e8-9f4e-7a1239fba665 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:05.249411 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08b729-e009-4bfb-946c-f0ec70a600fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:05.250075 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08b729-e009-4bfb-946c-f0ec70a600fc None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:05.250355 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08b729-e009-4bfb-946c-f0ec70a600fc None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:05.250630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08b729-e009-4bfb-946c-f0ec70a600fc None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:05.251347 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08b729-e009-4bfb-946c-f0ec70a600fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:05.251653 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08b729-e009-4bfb-946c-f0ec70a600fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:05.253575 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08b729-e009-4bfb-946c-f0ec70a600fc None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:05.264618 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 526/1074] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:05.270480 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adad8f4-ff96-4b23-b0a0-ebf35b1af5c9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:05.285223 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:05.374947 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adad8f4-ff96-4b23-b0a0-ebf35b1af5c9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:05.407232 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135fe75-bcab-4b9f-866c-a13f8aa67bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:05.408032 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135fe75-bcab-4b9f-866c-a13f8aa67bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:05.408318 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135fe75-bcab-4b9f-866c-a13f8aa67bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:05.408598 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135fe75-bcab-4b9f-866c-a13f8aa67bc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:05.415690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135fe75-bcab-4b9f-866c-a13f8aa67bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:05.417161 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135fe75-bcab-4b9f-866c-a13f8aa67bc3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e135fe75-bcab-4b9f-866c-a13f8aa67bc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:03:05.431611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:05.432543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:05.433841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:03:05.433841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:03:05.433841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:03:05.433841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:03:05.433841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:03:05.433841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:03:05.433841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:03:05.433841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:05.433841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 549/1075] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:05.438689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08b729-e009-4bfb-946c-f0ec70a600fc None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:05.478988 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:05.535153 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08b729-e009-4bfb-946c-f0ec70a600fc None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:05.567763 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4cd85-2a46-42fb-8c08-db8398211186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:05.568413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4cd85-2a46-42fb-8c08-db8398211186 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:05.568698 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4cd85-2a46-42fb-8c08-db8398211186 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:05.569002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4cd85-2a46-42fb-8c08-db8398211186 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:05.569784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4cd85-2a46-42fb-8c08-db8398211186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:05.570094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4cd85-2a46-42fb-8c08-db8398211186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:05.571523 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4cd85-2a46-42fb-8c08-db8398211186 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:05.583009 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 527/1076] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:05.589017 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135fe75-bcab-4b9f-866c-a13f8aa67bc3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:05.656392 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:05.687007 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135fe75-bcab-4b9f-866c-a13f8aa67bc3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:05.720062 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff369d-e662-4f3f-b6bc-5fdcc5795188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:05.720980 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff369d-e662-4f3f-b6bc-5fdcc5795188 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:05.721268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff369d-e662-4f3f-b6bc-5fdcc5795188 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:05.722079 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff369d-e662-4f3f-b6bc-5fdcc5795188 None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/1ff81129f179478d901b590a5be64f38/roles/008ab9f39a224eb08f13bc0c9c574e1c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:05.724264 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff369d-e662-4f3f-b6bc-5fdcc5795188 None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=1ff81129f179478d901b590a5be64f38, role_id=008ab9f39a224eb08f13bc0c9c574e1c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:05.725729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff369d-e662-4f3f-b6bc-5fdcc5795188 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:05.741506 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 550/1077] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:03:05 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/1ff81129f179478d901b590a5be64f38/roles/008ab9f39a224eb08f13bc0c9c574e1c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:03:06.254130 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae0f40-e9fd-44ea-92c3-6c5182785f28 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:06.254687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae0f40-e9fd-44ea-92c3-6c5182785f28 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:06.254687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae0f40-e9fd-44ea-92c3-6c5182785f28 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:06.256057 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 528/1078] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:06.261396 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f18ff4-fd51-412d-97c3-d3ff5ecc2ce3 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:06.261791 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f18ff4-fd51-412d-97c3-d3ff5ecc2ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:06.261968 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f18ff4-fd51-412d-97c3-d3ff5ecc2ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:06.278938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-40f18ff4-fd51-412d-97c3-d3ff5ecc2ce3 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:06.280118 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-40f18ff4-fd51-412d-97c3-d3ff5ecc2ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:06.345336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 551/1079] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:06.367587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae0f40-e9fd-44ea-92c3-6c5182785f28 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:06.464004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:06.468583 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae0f40-e9fd-44ea-92c3-6c5182785f28 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:06.501658 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512a332-f1c2-4e77-9846-c2fa4c63cc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:06.502425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a332-f1c2-4e77-9846-c2fa4c63cc47 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:06.502743 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a332-f1c2-4e77-9846-c2fa4c63cc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:06.503543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a332-f1c2-4e77-9846-c2fa4c63cc47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:06.513271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512a332-f1c2-4e77-9846-c2fa4c63cc47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e512a332-f1c2-4e77-9846-c2fa4c63cc47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:03:06.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:06.521810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:03:06.527761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 529/1080] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:03:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:06.529944 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f18ff4-fd51-412d-97c3-d3ff5ecc2ce3 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:06.587777 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:06.625937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f18ff4-fd51-412d-97c3-d3ff5ecc2ce3 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:06.658694 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e1c4d-801b-459b-8ace-beca4b0d04bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:06.659382 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e1c4d-801b-459b-8ace-beca4b0d04bb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:06.659673 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e1c4d-801b-459b-8ace-beca4b0d04bb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:06.659954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e1c4d-801b-459b-8ace-beca4b0d04bb None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:06.660695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e1c4d-801b-459b-8ace-beca4b0d04bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:06.661043 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e1c4d-801b-459b-8ace-beca4b0d04bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:06.662409 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e1c4d-801b-459b-8ace-beca4b0d04bb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:06.670594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 552/1081] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:03:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:06.676933 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512a332-f1c2-4e77-9846-c2fa4c63cc47 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:06.772536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512a332-f1c2-4e77-9846-c2fa4c63cc47 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:06.805598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed16fd-ef67-40e9-b826-72ed8aa98d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:06.806515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed16fd-ef67-40e9-b826-72ed8aa98d45 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:06.806797 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed16fd-ef67-40e9-b826-72ed8aa98d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:06.807071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed16fd-ef67-40e9-b826-72ed8aa98d45 None admin] PATH_INFO: `/v3/users/3331dd3cd6d84a039b3175612f02fbd9` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:06.808349 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed16fd-ef67-40e9-b826-72ed8aa98d45 None admin] RBAC: Authorizing `identity:get_user(user_id=3331dd3cd6d84a039b3175612f02fbd9)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:06.809884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed16fd-ef67-40e9-b826-72ed8aa98d45 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:06.811607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 530/1082] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:06 2022] GET /identity/v3/users/3331dd3cd6d84a039b3175612f02fbd9 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:06.818208 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e1c4d-801b-459b-8ace-beca4b0d04bb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:06.913444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e1c4d-801b-459b-8ace-beca4b0d04bb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:06.936987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:06.948072 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a064d49-9710-4e39-849a-3f9bdc9d808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:06.948955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a064d49-9710-4e39-849a-3f9bdc9d808d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:06.949242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a064d49-9710-4e39-849a-3f9bdc9d808d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:06.949519 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a064d49-9710-4e39-849a-3f9bdc9d808d None admin] PATH_INFO: `/v3/projects/60573cc4e1444232b83c0719437d6e20` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:06.950675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a064d49-9710-4e39-849a-3f9bdc9d808d None admin] RBAC: Authorizing `identity:get_project(project_id=60573cc4e1444232b83c0719437d6e20)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:06.952088 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a064d49-9710-4e39-849a-3f9bdc9d808d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:06.953800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 553/1083] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:06 2022] GET /identity/v3/projects/60573cc4e1444232b83c0719437d6e20 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:06.959655 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed16fd-ef67-40e9-b826-72ed8aa98d45 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:06.987630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:07.061167 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed16fd-ef67-40e9-b826-72ed8aa98d45 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:07.094657 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052bcf6-95ae-413b-9fc1-21acd20f72ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:07.095547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bcf6-95ae-413b-9fc1-21acd20f72ca None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:07.095832 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bcf6-95ae-413b-9fc1-21acd20f72ca None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:07.096110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bcf6-95ae-413b-9fc1-21acd20f72ca None admin] PATH_INFO: `/v3/projects/60573cc4e1444232b83c0719437d6e20/users/3331dd3cd6d84a039b3175612f02fbd9/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:07.098618 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052bcf6-95ae-413b-9fc1-21acd20f72ca None admin] RBAC: Authorizing `identity:create_grant(project_id=60573cc4e1444232b83c0719437d6e20, user_id=3331dd3cd6d84a039b3175612f02fbd9, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:07.100328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052bcf6-95ae-413b-9fc1-21acd20f72ca None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:07.113678 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 531/1084] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:03:06 2022] PUT /identity/v3/projects/60573cc4e1444232b83c0719437d6e20/users/3331dd3cd6d84a039b3175612f02fbd9/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:03:07.741556 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5479-2795-4326-b1e0-13a0efb4ebff None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:07.742084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5479-2795-4326-b1e0-13a0efb4ebff None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:07.742176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5479-2795-4326-b1e0-13a0efb4ebff None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:07.743468 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 554/1085] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:07.748420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118c02-f88e-47d6-bb2e-23c195fff053 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:07.748821 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118c02-f88e-47d6-bb2e-23c195fff053 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:07.749010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118c02-f88e-47d6-bb2e-23c195fff053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:07.765171 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5f118c02-f88e-47d6-bb2e-23c195fff053 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:07.766366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5f118c02-f88e-47d6-bb2e-23c195fff053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:07.831922 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 532/1086] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:07.854936 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5479-2795-4326-b1e0-13a0efb4ebff None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:07.957114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5479-2795-4326-b1e0-13a0efb4ebff None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:07.988903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2aa47-3c99-4fff-b317-a2b854051555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:07.992998 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2aa47-3c99-4fff-b317-a2b854051555 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:07.993262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2aa47-3c99-4fff-b317-a2b854051555 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:07.993544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2aa47-3c99-4fff-b317-a2b854051555 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:08.005786 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2aa47-3c99-4fff-b317-a2b854051555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ecc2aa47-3c99-4fff-b317-a2b854051555 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:03:08.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:08.020129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:08.025849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 555/1087] 10.222.0.13 () {56 vars in 1120 bytes} [Tue Jul 5 10:03:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:08.026555 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118c02-f88e-47d6-bb2e-23c195fff053 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:08.045790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:08.123995 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118c02-f88e-47d6-bb2e-23c195fff053 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:08.157281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ba58-de07-46c0-88e2-7a534738e58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:08.157950 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ba58-de07-46c0-88e2-7a534738e58e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:08.158236 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ba58-de07-46c0-88e2-7a534738e58e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:08.158513 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ba58-de07-46c0-88e2-7a534738e58e None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:08.159258 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108ba58-de07-46c0-88e2-7a534738e58e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:08.159565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108ba58-de07-46c0-88e2-7a534738e58e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:08.160942 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108ba58-de07-46c0-88e2-7a534738e58e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:08.168712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 533/1088] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 10:03:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:08.175052 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2aa47-3c99-4fff-b317-a2b854051555 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:08.228082 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:08.273680 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2aa47-3c99-4fff-b317-a2b854051555 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:08.307224 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037a172-f76c-4a8e-881a-7075f99fe45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:08.308034 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a172-f76c-4a8e-881a-7075f99fe45e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:08.308319 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a172-f76c-4a8e-881a-7075f99fe45e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:08.308595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a172-f76c-4a8e-881a-7075f99fe45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:08.319589 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037a172-f76c-4a8e-881a-7075f99fe45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:08.321080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037a172-f76c-4a8e-881a-7075f99fe45e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c037a172-f76c-4a8e-881a-7075f99fe45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:03:08.338433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:08.339444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:08.340376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:03:08.340376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:03:08.340376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:08.340376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:08.340376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 556/1089] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:08.345309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ba58-de07-46c0-88e2-7a534738e58e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:08.422985 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:08.442272 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ba58-de07-46c0-88e2-7a534738e58e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:08.474552 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c8a84-730a-4351-8332-b7447c20920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:08.475203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8a84-730a-4351-8332-b7447c20920f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:08.475488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8a84-730a-4351-8332-b7447c20920f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:08.475765 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8a84-730a-4351-8332-b7447c20920f None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:08.476477 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c8a84-730a-4351-8332-b7447c20920f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:08.476785 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c8a84-730a-4351-8332-b7447c20920f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:08.478177 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c8a84-730a-4351-8332-b7447c20920f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:08.489422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 534/1090] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:08.494875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037a172-f76c-4a8e-881a-7075f99fe45e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:08.592427 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037a172-f76c-4a8e-881a-7075f99fe45e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:08.594661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:08.624912 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a1337-dadd-404f-8db2-fe7450222683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:08.625713 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a1337-dadd-404f-8db2-fe7450222683 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:08.625993 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a1337-dadd-404f-8db2-fe7450222683 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:08.626268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a1337-dadd-404f-8db2-fe7450222683 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:08.646265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a1337-dadd-404f-8db2-fe7450222683 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:08.647704 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a1337-dadd-404f-8db2-fe7450222683 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-871a1337-dadd-404f-8db2-fe7450222683 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:03:08.662428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:08.663544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:08.664516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:08.664516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:08.664516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:03:08.664516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:03:08.664516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:03:08.664516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:03:08.664516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:03:08.664516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:03:08.664516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 10:03:08.664516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:08.664516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 557/1091] 10.222.0.13 () {56 vars in 1093 bytes} [Tue Jul 5 10:03:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:03:08.669303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c8a84-730a-4351-8332-b7447c20920f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:08.764905 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c8a84-730a-4351-8332-b7447c20920f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:08.799142 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705d04c-68f9-4c43-a7eb-8f9935a9bb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:08.800326 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705d04c-68f9-4c43-a7eb-8f9935a9bb5f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:08.800611 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705d04c-68f9-4c43-a7eb-8f9935a9bb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:08.800885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705d04c-68f9-4c43-a7eb-8f9935a9bb5f None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:08.801732 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705d04c-68f9-4c43-a7eb-8f9935a9bb5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:08.802042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705d04c-68f9-4c43-a7eb-8f9935a9bb5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:08.803465 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705d04c-68f9-4c43-a7eb-8f9935a9bb5f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:08.811959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:08.821285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 535/1092] 10.222.0.13 () {56 vars in 1133 bytes} [Tue Jul 5 10:03:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:08.826960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a1337-dadd-404f-8db2-fe7450222683 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:08.922894 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a1337-dadd-404f-8db2-fe7450222683 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:08.955643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95124a2b-cd23-49bf-aabb-3de4ee132659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:08.956308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124a2b-cd23-49bf-aabb-3de4ee132659 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:08.956593 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124a2b-cd23-49bf-aabb-3de4ee132659 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:08.956872 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124a2b-cd23-49bf-aabb-3de4ee132659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:08.985917 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:09.023779 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95124a2b-cd23-49bf-aabb-3de4ee132659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:09.025269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95124a2b-cd23-49bf-aabb-3de4ee132659 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:09.120079 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 558/1093] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:03:09.122605 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc509dc-7489-43c0-aa04-e58baa778bb1 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:09.122907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc509dc-7489-43c0-aa04-e58baa778bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:09.123191 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc509dc-7489-43c0-aa04-e58baa778bb1 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:09.124855 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 536/1094] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:09.125441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95124a2b-cd23-49bf-aabb-3de4ee132659 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:09.129681 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a6eaf-9efd-4d5a-950a-8616dc4ddf31 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:09.129967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a6eaf-9efd-4d5a-950a-8616dc4ddf31 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:09.130247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a6eaf-9efd-4d5a-950a-8616dc4ddf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:09.146058 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6b6a6eaf-9efd-4d5a-950a-8616dc4ddf31 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:09.147247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6b6a6eaf-9efd-4d5a-950a-8616dc4ddf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:09.185220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:09.214058 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 537/1095] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:03:09.221236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95124a2b-cd23-49bf-aabb-3de4ee132659 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:09.238198 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a6eaf-9efd-4d5a-950a-8616dc4ddf31 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:09.255108 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f30ed-1fce-429e-809a-18bdad85d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:09.255896 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f30ed-1fce-429e-809a-18bdad85d901 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:09.256177 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f30ed-1fce-429e-809a-18bdad85d901 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:09.256453 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f30ed-1fce-429e-809a-18bdad85d901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:09.266409 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f30ed-1fce-429e-809a-18bdad85d901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:09.267840 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f30ed-1fce-429e-809a-18bdad85d901 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-6d9f30ed-1fce-429e-809a-18bdad85d901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:03:09.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:09.286444 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:09.287371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:03:09.287371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:03:09.287371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:03:09.287371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:09.287371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 559/1096] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:03:09.293560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f30ed-1fce-429e-809a-18bdad85d901 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:09.337990 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a6eaf-9efd-4d5a-950a-8616dc4ddf31 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:09.363451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:09.371635 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d1e8e-e5f1-487b-a785-21562650a9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:09.372429 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d1e8e-e5f1-487b-a785-21562650a9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:09.372713 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d1e8e-e5f1-487b-a785-21562650a9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:09.373021 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d1e8e-e5f1-487b-a785-21562650a9a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:09.383309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d1e8e-e5f1-487b-a785-21562650a9a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:03:09.390765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f30ed-1fce-429e-809a-18bdad85d901 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-542d1e8e-e5f1-487b-a785-21562650a9a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:03:09.390945 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:03:09.393046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 538/1097] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:03:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:03:09.398482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d1e8e-e5f1-487b-a785-21562650a9a6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:09.412597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:09.431699 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2dea5-d4a3-4cfb-9a5f-ac43c6da17ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:09.432365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2dea5-d4a3-4cfb-9a5f-ac43c6da17ed None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:09.432655 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2dea5-d4a3-4cfb-9a5f-ac43c6da17ed None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:09.432963 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2dea5-d4a3-4cfb-9a5f-ac43c6da17ed None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:09.433682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2dea5-d4a3-4cfb-9a5f-ac43c6da17ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:09.433994 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2dea5-d4a3-4cfb-9a5f-ac43c6da17ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:09.435415 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2dea5-d4a3-4cfb-9a5f-ac43c6da17ed None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:09.447103 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 560/1098] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:09.452547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2dea5-d4a3-4cfb-9a5f-ac43c6da17ed None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:09.497684 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d1e8e-e5f1-487b-a785-21562650a9a6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:09.530426 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d78bb7-db75-4d18-bb4a-ff30538774ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:09.531088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d78bb7-db75-4d18-bb4a-ff30538774ab None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:09.531371 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d78bb7-db75-4d18-bb4a-ff30538774ab None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:09.531648 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d78bb7-db75-4d18-bb4a-ff30538774ab None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:09.532389 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d78bb7-db75-4d18-bb4a-ff30538774ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:09.532697 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d78bb7-db75-4d18-bb4a-ff30538774ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:09.534618 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d78bb7-db75-4d18-bb4a-ff30538774ab None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:09.542682 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 539/1099] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:03:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:09.548607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d78bb7-db75-4d18-bb4a-ff30538774ab None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:09.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2dea5-d4a3-4cfb-9a5f-ac43c6da17ed None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:09.583866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de6fa4-4004-49af-a213-43184f349205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:09.584804 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de6fa4-4004-49af-a213-43184f349205 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:09.585188 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de6fa4-4004-49af-a213-43184f349205 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:09.585476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de6fa4-4004-49af-a213-43184f349205 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:09.592499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de6fa4-4004-49af-a213-43184f349205 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:09.593981 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de6fa4-4004-49af-a213-43184f349205 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:09.597379 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-48de6fa4-4004-49af-a213-43184f349205 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:03:09.608800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:09.609783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:09.610675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:03:09.610675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:03:09.610675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:03:09.610675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:03:09.610675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:03:09.610675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:03:09.610675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:03:09.610675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:09.610675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 561/1100] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:03:09.615842 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de6fa4-4004-49af-a213-43184f349205 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:09.649092 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d78bb7-db75-4d18-bb4a-ff30538774ab None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:09.650223 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:09.683165 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2641d-bfb5-4ae2-a964-24aa486594ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:09.684040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2641d-bfb5-4ae2-a964-24aa486594ed None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:09.684322 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2641d-bfb5-4ae2-a964-24aa486594ed None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:09.684596 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2641d-bfb5-4ae2-a964-24aa486594ed None admin] PATH_INFO: `/v3/users/3331dd3cd6d84a039b3175612f02fbd9` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:09.685873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2641d-bfb5-4ae2-a964-24aa486594ed None admin] RBAC: Authorizing `identity:get_user(user_id=3331dd3cd6d84a039b3175612f02fbd9)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:09.687255 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2641d-bfb5-4ae2-a964-24aa486594ed None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:09.688883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 540/1101] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:09 2022] GET /identity/v3/users/3331dd3cd6d84a039b3175612f02fbd9 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:09.694518 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2641d-bfb5-4ae2-a964-24aa486594ed None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:09.718545 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de6fa4-4004-49af-a213-43184f349205 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:09.751702 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9641d-28ae-4d6d-81c8-f591e7ac098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:09.752355 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9641d-28ae-4d6d-81c8-f591e7ac098f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:09.752658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9641d-28ae-4d6d-81c8-f591e7ac098f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:09.752962 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9641d-28ae-4d6d-81c8-f591e7ac098f None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:09.753736 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9641d-28ae-4d6d-81c8-f591e7ac098f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:09.754067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9641d-28ae-4d6d-81c8-f591e7ac098f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:09.755489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9641d-28ae-4d6d-81c8-f591e7ac098f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:09.766736 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 562/1102] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:09.773072 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9641d-28ae-4d6d-81c8-f591e7ac098f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:09.792814 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2641d-bfb5-4ae2-a964-24aa486594ed None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:09.809270 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:09.827127 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da3602-c93d-4974-90ed-e2e0978e9bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:09.827776 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da3602-c93d-4974-90ed-e2e0978e9bbd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:09.828064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da3602-c93d-4974-90ed-e2e0978e9bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:09.828347 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da3602-c93d-4974-90ed-e2e0978e9bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:09.865477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:09.871510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9641d-28ae-4d6d-81c8-f591e7ac098f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:09.894883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da3602-c93d-4974-90ed-e2e0978e9bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:09.896337 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da3602-c93d-4974-90ed-e2e0978e9bbd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:09.904708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d4dc-24fb-431b-9075-56cd88c71ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:09.905566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d4dc-24fb-431b-9075-56cd88c71ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:09.905855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d4dc-24fb-431b-9075-56cd88c71ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:09.906131 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d4dc-24fb-431b-9075-56cd88c71ee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:09.906952 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d4dc-24fb-431b-9075-56cd88c71ee2 None admin] RBAC: Adding query filter params (role.id=008ab9f39a224eb08f13bc0c9c574e1c, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=1ff81129f179478d901b590a5be64f38) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:09.907268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d4dc-24fb-431b-9075-56cd88c71ee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:09.908672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d4dc-24fb-431b-9075-56cd88c71ee2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:09.914567 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 563/1103] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:03:09 2022] GET /identity/v3/role_assignments?user.id=1ff81129f179478d901b590a5be64f38&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=008ab9f39a224eb08f13bc0c9c574e1c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:10.007474 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 541/1104] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 10:03:10.008760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d4dc-24fb-431b-9075-56cd88c71ee2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:10.112010 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d4dc-24fb-431b-9075-56cd88c71ee2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:10.145306 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3a3ff-cf2c-4ee8-8606-4a95acf06a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:10.146163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3a3ff-cf2c-4ee8-8606-4a95acf06a90 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:10.146449 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3a3ff-cf2c-4ee8-8606-4a95acf06a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:10.146723 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3a3ff-cf2c-4ee8-8606-4a95acf06a90 None admin] PATH_INFO: `/v3/projects/60573cc4e1444232b83c0719437d6e20` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:10.147897 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3a3ff-cf2c-4ee8-8606-4a95acf06a90 None admin] RBAC: Authorizing `identity:get_project(project_id=60573cc4e1444232b83c0719437d6e20)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:10.149350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3a3ff-cf2c-4ee8-8606-4a95acf06a90 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:10.151034 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 564/1105] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:10 2022] GET /identity/v3/projects/60573cc4e1444232b83c0719437d6e20 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:10.157258 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da3602-c93d-4974-90ed-e2e0978e9bbd None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:10.176156 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:10.257333 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da3602-c93d-4974-90ed-e2e0978e9bbd None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:10.293459 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c466a4-5746-4e09-ae77-a0b295d4becf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:10.294045 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c466a4-5746-4e09-ae77-a0b295d4becf None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:10.294326 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c466a4-5746-4e09-ae77-a0b295d4becf None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:10.294598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c466a4-5746-4e09-ae77-a0b295d4becf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:10.295685 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c466a4-5746-4e09-ae77-a0b295d4becf None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=60573cc4e1444232b83c0719437d6e20, user.id=3331dd3cd6d84a039b3175612f02fbd9) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:10.295994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c466a4-5746-4e09-ae77-a0b295d4becf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:10.297488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c466a4-5746-4e09-ae77-a0b295d4becf None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:10.304227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 542/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:03:10 2022] GET /identity/v3/role_assignments?user.id=3331dd3cd6d84a039b3175612f02fbd9&scope.project.id=60573cc4e1444232b83c0719437d6e20&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:12.359762 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa554-26b8-4b87-8548-8da4bc00af3e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:12.360236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa554-26b8-4b87-8548-8da4bc00af3e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:12.360324 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa554-26b8-4b87-8548-8da4bc00af3e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:12.361709 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 565/1107] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:12.367712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b5e94-120b-40dc-afa0-94cf21082d34 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:12.368109 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b5e94-120b-40dc-afa0-94cf21082d34 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:12.368261 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b5e94-120b-40dc-afa0-94cf21082d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:12.394241 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-804b5e94-120b-40dc-afa0-94cf21082d34 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:12.395422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-804b5e94-120b-40dc-afa0-94cf21082d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:12.459982 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 543/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:12.485025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa554-26b8-4b87-8548-8da4bc00af3e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:12.512427 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:12.583544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa554-26b8-4b87-8548-8da4bc00af3e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:12.615996 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb87bf2-0ae8-4a84-88f8-6bd9159ca855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:12.616775 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87bf2-0ae8-4a84-88f8-6bd9159ca855 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:12.617089 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87bf2-0ae8-4a84-88f8-6bd9159ca855 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:12.617371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87bf2-0ae8-4a84-88f8-6bd9159ca855 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:12.618531 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb87bf2-0ae8-4a84-88f8-6bd9159ca855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:12.619955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb87bf2-0ae8-4a84-88f8-6bd9159ca855 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:12.621575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 566/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:12.627104 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b5e94-120b-40dc-afa0-94cf21082d34 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:12.641311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:12.725150 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b5e94-120b-40dc-afa0-94cf21082d34 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:12.758022 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8cfb3-5317-497a-bdce-8f82d88ebb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:12.758687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8cfb3-5317-497a-bdce-8f82d88ebb56 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:12.758969 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8cfb3-5317-497a-bdce-8f82d88ebb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:12.759244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8cfb3-5317-497a-bdce-8f82d88ebb56 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:12.759960 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8cfb3-5317-497a-bdce-8f82d88ebb56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:12.761412 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8cfb3-5317-497a-bdce-8f82d88ebb56 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:12.780409 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 544/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:03:12 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:03:14.825205 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7569ca-2d03-4e83-afea-f73879611c7a None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:14.825821 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7569ca-2d03-4e83-afea-f73879611c7a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:14.825821 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7569ca-2d03-4e83-afea-f73879611c7a None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:14.827127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 567/1111] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:14.832242 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb8baf-1c68-4526-a484-3014ed5413d6 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:14.832662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb8baf-1c68-4526-a484-3014ed5413d6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:14.832806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb8baf-1c68-4526-a484-3014ed5413d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:14.849167 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-dffb8baf-1c68-4526-a484-3014ed5413d6 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:14.850358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-dffb8baf-1c68-4526-a484-3014ed5413d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:14.909337 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:14.915438 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 545/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:14.939639 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7569ca-2d03-4e83-afea-f73879611c7a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:15.032093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:15.038778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7569ca-2d03-4e83-afea-f73879611c7a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:15.071252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc21129-18f4-49ca-bb8a-68ebe043b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:15.072102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21129-18f4-49ca-bb8a-68ebe043b3eb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:15.072385 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21129-18f4-49ca-bb8a-68ebe043b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:15.072658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21129-18f4-49ca-bb8a-68ebe043b3eb None admin] PATH_INFO: `/v3/roles/a11101f17a5c44e5b5454f2f8af57cf3` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:15.074126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc21129-18f4-49ca-bb8a-68ebe043b3eb None admin] RBAC: Authorizing `identity:get_role(role_id=a11101f17a5c44e5b5454f2f8af57cf3)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:15.075530 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc21129-18f4-49ca-bb8a-68ebe043b3eb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:15.076825 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 568/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:14 2022] GET /identity/v3/roles/a11101f17a5c44e5b5454f2f8af57cf3 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:15.082690 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb8baf-1c68-4526-a484-3014ed5413d6 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:15.177178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb8baf-1c68-4526-a484-3014ed5413d6 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:15.209409 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10840c86-8ac1-4f73-ba76-addc61132744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:15.210265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840c86-8ac1-4f73-ba76-addc61132744 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:15.210549 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840c86-8ac1-4f73-ba76-addc61132744 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:15.210824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840c86-8ac1-4f73-ba76-addc61132744 None admin] PATH_INFO: `/v3/users/22418da596fc4443b1f27b2807a9881c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:15.223848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10840c86-8ac1-4f73-ba76-addc61132744 None admin] RBAC: Authorizing `identity:get_user(user_id=22418da596fc4443b1f27b2807a9881c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:15.225296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10840c86-8ac1-4f73-ba76-addc61132744 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:15.226925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 546/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:15 2022] GET /identity/v3/users/22418da596fc4443b1f27b2807a9881c => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:15.232386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc21129-18f4-49ca-bb8a-68ebe043b3eb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:15.335885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc21129-18f4-49ca-bb8a-68ebe043b3eb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:15.368280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017f2cb-41aa-42c7-b87c-b46c0856acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:15.368933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017f2cb-41aa-42c7-b87c-b46c0856acb8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:15.369221 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017f2cb-41aa-42c7-b87c-b46c0856acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:15.369498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017f2cb-41aa-42c7-b87c-b46c0856acb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:15.397843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:15.433462 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017f2cb-41aa-42c7-b87c-b46c0856acb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:15.434889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017f2cb-41aa-42c7-b87c-b46c0856acb8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:15.528390 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 569/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:03:15.534842 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10840c86-8ac1-4f73-ba76-addc61132744 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:15.588546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:15.630578 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10840c86-8ac1-4f73-ba76-addc61132744 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:15.663244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9eeff8-4e32-4931-83cb-c89f3088405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:15.664094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eeff8-4e32-4931-83cb-c89f3088405d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:15.664393 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eeff8-4e32-4931-83cb-c89f3088405d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:15.664662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eeff8-4e32-4931-83cb-c89f3088405d None admin] PATH_INFO: `/v3/projects/60573cc4e1444232b83c0719437d6e20` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:15.665863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9eeff8-4e32-4931-83cb-c89f3088405d None admin] RBAC: Authorizing `identity:get_project(project_id=60573cc4e1444232b83c0719437d6e20)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:15.667287 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9eeff8-4e32-4931-83cb-c89f3088405d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:15.669116 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 547/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:15 2022] GET /identity/v3/projects/60573cc4e1444232b83c0719437d6e20 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:15.675562 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017f2cb-41aa-42c7-b87c-b46c0856acb8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:15.734366 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:15.771845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017f2cb-41aa-42c7-b87c-b46c0856acb8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:15.804907 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c96cf1-8df6-4c1d-a705-08202ae4ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:15.805557 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c96cf1-8df6-4c1d-a705-08202ae4ad53 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:15.805839 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c96cf1-8df6-4c1d-a705-08202ae4ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:15.806114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c96cf1-8df6-4c1d-a705-08202ae4ad53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:15.806954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c96cf1-8df6-4c1d-a705-08202ae4ad53 None admin] RBAC: Adding query filter params (role.id=a11101f17a5c44e5b5454f2f8af57cf3, scope.project.id=60573cc4e1444232b83c0719437d6e20, user.id=22418da596fc4443b1f27b2807a9881c) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:15.807263 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c96cf1-8df6-4c1d-a705-08202ae4ad53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:15.808670 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c96cf1-8df6-4c1d-a705-08202ae4ad53 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:15.813940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 570/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:03:15 2022] GET /identity/v3/role_assignments?user.id=22418da596fc4443b1f27b2807a9881c&scope.project.id=60573cc4e1444232b83c0719437d6e20&role.id=a11101f17a5c44e5b5454f2f8af57cf3 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:17.807269 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee1953-da6a-4f8f-9355-cf2c85bcf473 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:17.807797 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee1953-da6a-4f8f-9355-cf2c85bcf473 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:17.807797 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee1953-da6a-4f8f-9355-cf2c85bcf473 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:17.809255 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 548/1118] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:17.814488 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411461d-4eb4-4338-933a-cd6727787bb4 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:17.814864 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411461d-4eb4-4338-933a-cd6727787bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:17.815613 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411461d-4eb4-4338-933a-cd6727787bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:17.832002 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0411461d-4eb4-4338-933a-cd6727787bb4 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:17.833226 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0411461d-4eb4-4338-933a-cd6727787bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:17.895849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 571/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:17.918322 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee1953-da6a-4f8f-9355-cf2c85bcf473 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:18.014880 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee1953-da6a-4f8f-9355-cf2c85bcf473 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:18.036644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:18.047764 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d27e2f-f1a0-4525-a1fe-d0a9c3af1c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:18.048598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d27e2f-f1a0-4525-a1fe-d0a9c3af1c52 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:18.048877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d27e2f-f1a0-4525-a1fe-d0a9c3af1c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:18.049178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d27e2f-f1a0-4525-a1fe-d0a9c3af1c52 None admin] PATH_INFO: `/v3/roles/a11101f17a5c44e5b5454f2f8af57cf3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:18.051160 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d27e2f-f1a0-4525-a1fe-d0a9c3af1c52 None admin] RBAC: Authorizing `identity:get_role(role_id=a11101f17a5c44e5b5454f2f8af57cf3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:18.052508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d27e2f-f1a0-4525-a1fe-d0a9c3af1c52 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:18.053870 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 549/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:17 2022] GET /identity/v3/roles/a11101f17a5c44e5b5454f2f8af57cf3 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:18.059636 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411461d-4eb4-4338-933a-cd6727787bb4 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:18.116555 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:18.155967 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411461d-4eb4-4338-933a-cd6727787bb4 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:18.189153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e544db-a9ba-430d-988b-977149249c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:18.190043 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e544db-a9ba-430d-988b-977149249c46 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:18.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e544db-a9ba-430d-988b-977149249c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:18.190604 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e544db-a9ba-430d-988b-977149249c46 None admin] PATH_INFO: `/v3/users/22418da596fc4443b1f27b2807a9881c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:18.191774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e544db-a9ba-430d-988b-977149249c46 None admin] RBAC: Authorizing `identity:get_user(user_id=22418da596fc4443b1f27b2807a9881c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:18.193225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e544db-a9ba-430d-988b-977149249c46 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:18.194823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 572/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:18 2022] GET /identity/v3/users/22418da596fc4443b1f27b2807a9881c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:18.200543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d27e2f-f1a0-4525-a1fe-d0a9c3af1c52 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:18.296099 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d27e2f-f1a0-4525-a1fe-d0a9c3af1c52 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:18.328392 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb65d7-e11a-4835-baf8-4b1a1de00eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:18.332227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb65d7-e11a-4835-baf8-4b1a1de00eed None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:18.332227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb65d7-e11a-4835-baf8-4b1a1de00eed None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:18.332227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb65d7-e11a-4835-baf8-4b1a1de00eed None admin] PATH_INFO: `/v3/projects/60573cc4e1444232b83c0719437d6e20` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:18.332227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb65d7-e11a-4835-baf8-4b1a1de00eed None admin] RBAC: Authorizing `identity:get_project(project_id=60573cc4e1444232b83c0719437d6e20)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:18.334684 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb65d7-e11a-4835-baf8-4b1a1de00eed None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:18.336915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 550/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:18 2022] GET /identity/v3/projects/60573cc4e1444232b83c0719437d6e20 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:18.342914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e544db-a9ba-430d-988b-977149249c46 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:18.438456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e544db-a9ba-430d-988b-977149249c46 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:18.462917 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:18.471963 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8872d8-315f-4f01-a97e-6c388ddd39f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:18.472847 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8872d8-315f-4f01-a97e-6c388ddd39f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:18.473160 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8872d8-315f-4f01-a97e-6c388ddd39f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:18.473438 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8872d8-315f-4f01-a97e-6c388ddd39f7 None admin] PATH_INFO: `/v3/projects/60573cc4e1444232b83c0719437d6e20/users/22418da596fc4443b1f27b2807a9881c/roles/a11101f17a5c44e5b5454f2f8af57cf3` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:18.475607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8872d8-315f-4f01-a97e-6c388ddd39f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=60573cc4e1444232b83c0719437d6e20, user_id=22418da596fc4443b1f27b2807a9881c, role_id=a11101f17a5c44e5b5454f2f8af57cf3)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:18.477054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8872d8-315f-4f01-a97e-6c388ddd39f7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:18.488802 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 573/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:03:18 2022] PUT /identity/v3/projects/60573cc4e1444232b83c0719437d6e20/users/22418da596fc4443b1f27b2807a9881c/roles/a11101f17a5c44e5b5454f2f8af57cf3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:03:20.467613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706c9ba-939a-487c-a297-261aecb5f474 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:20.468121 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706c9ba-939a-487c-a297-261aecb5f474 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:20.468224 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706c9ba-939a-487c-a297-261aecb5f474 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:20.469565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 551/1124] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:20.475201 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d641e1-821c-4359-b6ce-5c114c695656 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:20.475585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d641e1-821c-4359-b6ce-5c114c695656 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:20.475767 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d641e1-821c-4359-b6ce-5c114c695656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:20.492487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-89d641e1-821c-4359-b6ce-5c114c695656 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:20.493690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-89d641e1-821c-4359-b6ce-5c114c695656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:20.557680 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 574/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:20.580558 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706c9ba-939a-487c-a297-261aecb5f474 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:20.638573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:20.678885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706c9ba-939a-487c-a297-261aecb5f474 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:20.711246 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1030053-49ce-49b5-af36-528a5b92213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:20.712083 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1030053-49ce-49b5-af36-528a5b92213c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:20.712361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1030053-49ce-49b5-af36-528a5b92213c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:20.712635 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1030053-49ce-49b5-af36-528a5b92213c None admin] PATH_INFO: `/v3/roles/a11101f17a5c44e5b5454f2f8af57cf3` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:20.714107 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1030053-49ce-49b5-af36-528a5b92213c None admin] RBAC: Authorizing `identity:get_role(role_id=a11101f17a5c44e5b5454f2f8af57cf3)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:20.715460 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1030053-49ce-49b5-af36-528a5b92213c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:20.716795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 552/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:20 2022] GET /identity/v3/roles/a11101f17a5c44e5b5454f2f8af57cf3 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:20.722979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d641e1-821c-4359-b6ce-5c114c695656 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:20.816317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d641e1-821c-4359-b6ce-5c114c695656 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:20.832228 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:20.849668 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0b3a0-b9a0-4e04-b1e4-b399269c1042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:20.850524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b3a0-b9a0-4e04-b1e4-b399269c1042 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:20.850806 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b3a0-b9a0-4e04-b1e4-b399269c1042 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:20.851083 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b3a0-b9a0-4e04-b1e4-b399269c1042 None admin] PATH_INFO: `/v3/users/22418da596fc4443b1f27b2807a9881c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:20.852241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0b3a0-b9a0-4e04-b1e4-b399269c1042 None admin] RBAC: Authorizing `identity:get_user(user_id=22418da596fc4443b1f27b2807a9881c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:20.853679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0b3a0-b9a0-4e04-b1e4-b399269c1042 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:20.855268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 575/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:20 2022] GET /identity/v3/users/22418da596fc4443b1f27b2807a9881c => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:20.860753 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1030053-49ce-49b5-af36-528a5b92213c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:20.955239 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1030053-49ce-49b5-af36-528a5b92213c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:20.981298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:20.989895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df760d2d-9d49-4bed-9d67-b05e7caa9415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:20.990520 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760d2d-9d49-4bed-9d67-b05e7caa9415 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:20.990800 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760d2d-9d49-4bed-9d67-b05e7caa9415 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:20.991073 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760d2d-9d49-4bed-9d67-b05e7caa9415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:21.055564 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df760d2d-9d49-4bed-9d67-b05e7caa9415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:21.057016 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df760d2d-9d49-4bed-9d67-b05e7caa9415 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:21.149360 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 553/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:03:21.155016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0b3a0-b9a0-4e04-b1e4-b399269c1042 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:21.249520 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0b3a0-b9a0-4e04-b1e4-b399269c1042 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:21.282194 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acddce-3a7d-4581-ba3e-25c3ab27f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:21.283040 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acddce-3a7d-4581-ba3e-25c3ab27f790 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:21.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acddce-3a7d-4581-ba3e-25c3ab27f790 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:21.283654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acddce-3a7d-4581-ba3e-25c3ab27f790 None admin] PATH_INFO: `/v3/projects/60573cc4e1444232b83c0719437d6e20` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:21.284833 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acddce-3a7d-4581-ba3e-25c3ab27f790 None admin] RBAC: Authorizing `identity:get_project(project_id=60573cc4e1444232b83c0719437d6e20)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:21.286281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acddce-3a7d-4581-ba3e-25c3ab27f790 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:21.287967 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 576/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:21 2022] GET /identity/v3/projects/60573cc4e1444232b83c0719437d6e20 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:21.293907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df760d2d-9d49-4bed-9d67-b05e7caa9415 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:21.320620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:21.390603 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df760d2d-9d49-4bed-9d67-b05e7caa9415 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:21.422932 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d45c6-d87a-4229-8f36-af9b7c34d46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:21.423515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d45c6-d87a-4229-8f36-af9b7c34d46b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:21.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d45c6-d87a-4229-8f36-af9b7c34d46b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:21.424067 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d45c6-d87a-4229-8f36-af9b7c34d46b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:21.425424 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d45c6-d87a-4229-8f36-af9b7c34d46b None admin] RBAC: Adding query filter params (role.id=a11101f17a5c44e5b5454f2f8af57cf3, scope.project.id=60573cc4e1444232b83c0719437d6e20, user.id=22418da596fc4443b1f27b2807a9881c) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:21.425735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d45c6-d87a-4229-8f36-af9b7c34d46b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:21.427148 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d45c6-d87a-4229-8f36-af9b7c34d46b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:21.432702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 554/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:03:21 2022] GET /identity/v3/role_assignments?user.id=22418da596fc4443b1f27b2807a9881c&scope.project.id=60573cc4e1444232b83c0719437d6e20&role.id=a11101f17a5c44e5b5454f2f8af57cf3 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:23.453399 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039b411-08d0-4910-8cfb-92c3f3a04a11 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:23.453938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039b411-08d0-4910-8cfb-92c3f3a04a11 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:23.453938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039b411-08d0-4910-8cfb-92c3f3a04a11 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:23.455342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 577/1131] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:23.460942 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2ccab-0bd8-474d-80b5-9b12f1a0e020 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:23.461344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2ccab-0bd8-474d-80b5-9b12f1a0e020 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:23.461515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2ccab-0bd8-474d-80b5-9b12f1a0e020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:23.477694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f4e2ccab-0bd8-474d-80b5-9b12f1a0e020 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:23.478874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f4e2ccab-0bd8-474d-80b5-9b12f1a0e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:23.542184 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 555/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:23.565836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039b411-08d0-4910-8cfb-92c3f3a04a11 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:23.617177 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:23.663407 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039b411-08d0-4910-8cfb-92c3f3a04a11 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:23.696487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bada7e8-4721-4214-9b1c-83dc54cba092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:23.697285 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bada7e8-4721-4214-9b1c-83dc54cba092 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:23.697569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bada7e8-4721-4214-9b1c-83dc54cba092 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:23.697843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bada7e8-4721-4214-9b1c-83dc54cba092 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:23.698984 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bada7e8-4721-4214-9b1c-83dc54cba092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:23.700386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bada7e8-4721-4214-9b1c-83dc54cba092 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:23.701991 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 578/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:23.708157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2ccab-0bd8-474d-80b5-9b12f1a0e020 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:23.731883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:23.805519 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2ccab-0bd8-474d-80b5-9b12f1a0e020 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:23.837586 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a326aa-456b-4b50-9827-4440de90989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:23.838174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a326aa-456b-4b50-9827-4440de90989e None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:23.838458 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a326aa-456b-4b50-9827-4440de90989e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:23.838736 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a326aa-456b-4b50-9827-4440de90989e None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:23.839431 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a326aa-456b-4b50-9827-4440de90989e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:23.840855 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a326aa-456b-4b50-9827-4440de90989e None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:23.866047 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 556/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:03:23 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:03:25.918695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e2b65-60c2-4127-a086-23141fa54129 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:25.919237 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e2b65-60c2-4127-a086-23141fa54129 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:25.919335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e2b65-60c2-4127-a086-23141fa54129 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:25.920881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 579/1135] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:25.926684 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134221-b40d-4939-9d9e-6ad9b36dfe50 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:25.927083 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134221-b40d-4939-9d9e-6ad9b36dfe50 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:25.927252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134221-b40d-4939-9d9e-6ad9b36dfe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:25.944127 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-cf134221-b40d-4939-9d9e-6ad9b36dfe50 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:25.945374 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-cf134221-b40d-4939-9d9e-6ad9b36dfe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:26.008722 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 557/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:26.034143 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e2b65-60c2-4127-a086-23141fa54129 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:26.132177 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e2b65-60c2-4127-a086-23141fa54129 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:26.151185 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:26.164654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c16deb-1666-40b7-99c3-9e5570a63ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:26.165462 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16deb-1666-40b7-99c3-9e5570a63ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:26.165745 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16deb-1666-40b7-99c3-9e5570a63ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:26.166020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16deb-1666-40b7-99c3-9e5570a63ca2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:26.167171 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c16deb-1666-40b7-99c3-9e5570a63ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:26.168588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c16deb-1666-40b7-99c3-9e5570a63ca2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:26.170512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 580/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:03:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:26.176639 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134221-b40d-4939-9d9e-6ad9b36dfe50 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:26.179691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:26.272308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134221-b40d-4939-9d9e-6ad9b36dfe50 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:26.304989 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaa53a-1b5d-4dfc-b3c4-1248c07952f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:26.305655 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa53a-1b5d-4dfc-b3c4-1248c07952f5 None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:26.305941 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa53a-1b5d-4dfc-b3c4-1248c07952f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:26.306214 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa53a-1b5d-4dfc-b3c4-1248c07952f5 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:26.306920 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaa53a-1b5d-4dfc-b3c4-1248c07952f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:26.308355 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaa53a-1b5d-4dfc-b3c4-1248c07952f5 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:26.327496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 558/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:03:26 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:03:28.360122 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8f990-7f4c-4be7-adbe-a3fc41328ebe None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:28.360632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8f990-7f4c-4be7-adbe-a3fc41328ebe None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:28.360741 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8f990-7f4c-4be7-adbe-a3fc41328ebe None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:28.362099 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 581/1139] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:28.367139 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791f17a-14b5-4c4b-9f65-b79b523a216c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:28.367566 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791f17a-14b5-4c4b-9f65-b79b523a216c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:28.367698 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791f17a-14b5-4c4b-9f65-b79b523a216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:28.383878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2791f17a-14b5-4c4b-9f65-b79b523a216c None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:28.385093 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2791f17a-14b5-4c4b-9f65-b79b523a216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:28.438252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:28.450263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 559/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:03:28.474385 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8f990-7f4c-4be7-adbe-a3fc41328ebe None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:28.571467 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8f990-7f4c-4be7-adbe-a3fc41328ebe None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:28.603681 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f4592-2dfe-44df-8169-4e084164ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:28.604458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4592-2dfe-44df-8169-4e084164ba59 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:28.604742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4592-2dfe-44df-8169-4e084164ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:28.605048 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4592-2dfe-44df-8169-4e084164ba59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:28.614836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f4592-2dfe-44df-8169-4e084164ba59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-f88f4592-2dfe-44df-8169-4e084164ba59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:03:28.622441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:28.623553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:28.624484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 582/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:03:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:28.630010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791f17a-14b5-4c4b-9f65-b79b523a216c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:28.725464 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791f17a-14b5-4c4b-9f65-b79b523a216c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:28.758356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79552167-d9c1-4852-a39c-a6e0b8e3785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:28.759013 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552167-d9c1-4852-a39c-a6e0b8e3785c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:28.759301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552167-d9c1-4852-a39c-a6e0b8e3785c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:28.759583 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79552167-d9c1-4852-a39c-a6e0b8e3785c None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:28.760323 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79552167-d9c1-4852-a39c-a6e0b8e3785c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:28.760634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79552167-d9c1-4852-a39c-a6e0b8e3785c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:28.762038 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79552167-d9c1-4852-a39c-a6e0b8e3785c None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:28.770353 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 560/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:03:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:03:28.775900 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f4592-2dfe-44df-8169-4e084164ba59 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:28.823309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:28.872024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f4592-2dfe-44df-8169-4e084164ba59 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:28.904466 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0053a59-49df-4fc9-9f52-29060716e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:28.905343 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0053a59-49df-4fc9-9f52-29060716e55f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:28.905626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0053a59-49df-4fc9-9f52-29060716e55f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:28.905900 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0053a59-49df-4fc9-9f52-29060716e55f None admin] PATH_INFO: `/v3/users/014922ed9d50425da9d7f1687a5dd179` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:28.918326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0053a59-49df-4fc9-9f52-29060716e55f None admin] RBAC: Authorizing `identity:get_user(user_id=014922ed9d50425da9d7f1687a5dd179)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:28.919755 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0053a59-49df-4fc9-9f52-29060716e55f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:28.921655 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 583/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:28 2022] GET /identity/v3/users/014922ed9d50425da9d7f1687a5dd179 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:28.927848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79552167-d9c1-4852-a39c-a6e0b8e3785c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:28.978353 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:29.025422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79552167-d9c1-4852-a39c-a6e0b8e3785c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:29.057704 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd5f99-31fc-407f-a08a-65a36bc109f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:29.058366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd5f99-31fc-407f-a08a-65a36bc109f8 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:29.058652 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd5f99-31fc-407f-a08a-65a36bc109f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:29.058930 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd5f99-31fc-407f-a08a-65a36bc109f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:29.125156 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd5f99-31fc-407f-a08a-65a36bc109f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:29.126550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd5f99-31fc-407f-a08a-65a36bc109f8 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:29.175431 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:29.221465 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 561/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:03:29.227248 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0053a59-49df-4fc9-9f52-29060716e55f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:29.324651 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0053a59-49df-4fc9-9f52-29060716e55f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:29.332209 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:29.357945 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead20fca-59ac-4645-8dc2-735beff4ab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:29.358799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead20fca-59ac-4645-8dc2-735beff4ab2b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:29.359084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead20fca-59ac-4645-8dc2-735beff4ab2b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:29.359364 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead20fca-59ac-4645-8dc2-735beff4ab2b None admin] PATH_INFO: `/v3/projects/d8c35f353c9041cdbecb0ba877fe773e` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:29.360516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead20fca-59ac-4645-8dc2-735beff4ab2b None admin] RBAC: Authorizing `identity:get_project(project_id=d8c35f353c9041cdbecb0ba877fe773e)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:29.362040 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead20fca-59ac-4645-8dc2-735beff4ab2b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:29.363729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 584/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:29 2022] GET /identity/v3/projects/d8c35f353c9041cdbecb0ba877fe773e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:29.369758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd5f99-31fc-407f-a08a-65a36bc109f8 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:29.466217 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd5f99-31fc-407f-a08a-65a36bc109f8 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:29.498065 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304c281-e7bc-4b18-ae8d-14354707f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:29.498708 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c281-e7bc-4b18-ae8d-14354707f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:29.498992 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c281-e7bc-4b18-ae8d-14354707f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:29.499269 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c281-e7bc-4b18-ae8d-14354707f1e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:29.500093 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304c281-e7bc-4b18-ae8d-14354707f1e4 None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=d8c35f353c9041cdbecb0ba877fe773e, user.id=014922ed9d50425da9d7f1687a5dd179) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:29.500408 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304c281-e7bc-4b18-ae8d-14354707f1e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:29.501862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304c281-e7bc-4b18-ae8d-14354707f1e4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:29.507593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 562/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:03:29 2022] GET /identity/v3/role_assignments?user.id=014922ed9d50425da9d7f1687a5dd179&scope.project.id=d8c35f353c9041cdbecb0ba877fe773e&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:31.488163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de19b5-9536-473e-9c90-7220e4d76226 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:31.488719 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de19b5-9536-473e-9c90-7220e4d76226 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:31.488719 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de19b5-9536-473e-9c90-7220e4d76226 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:31.490118 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 585/1147] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:31.495162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b8d00-8bce-4f6d-97bb-90c509da86a2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:31.495578 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b8d00-8bce-4f6d-97bb-90c509da86a2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:31.495723 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b8d00-8bce-4f6d-97bb-90c509da86a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:31.512065 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-265b8d00-8bce-4f6d-97bb-90c509da86a2 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:31.513291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-265b8d00-8bce-4f6d-97bb-90c509da86a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:31.524082 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:31.578444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 563/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:31.600568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de19b5-9536-473e-9c90-7220e4d76226 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:31.700324 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de19b5-9536-473e-9c90-7220e4d76226 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:31.732454 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb9b8c-7f29-4948-a528-0c1a32e7a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:31.733331 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb9b8c-7f29-4948-a528-0c1a32e7a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:31.733612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb9b8c-7f29-4948-a528-0c1a32e7a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:31.733880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb9b8c-7f29-4948-a528-0c1a32e7a1a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:31.743491 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb9b8c-7f29-4948-a528-0c1a32e7a1a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e3eb9b8c-7f29-4948-a528-0c1a32e7a1a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:03:31.751036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:31.752127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:31.754740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 586/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:03:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:31.758785 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b8d00-8bce-4f6d-97bb-90c509da86a2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:31.852630 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b8d00-8bce-4f6d-97bb-90c509da86a2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:31.884631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdead5-e86a-4e1a-a708-2a4eede584df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:31.885308 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdead5-e86a-4e1a-a708-2a4eede584df None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:31.885592 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdead5-e86a-4e1a-a708-2a4eede584df None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:31.885870 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdead5-e86a-4e1a-a708-2a4eede584df None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:31.886609 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdead5-e86a-4e1a-a708-2a4eede584df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:31.886919 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdead5-e86a-4e1a-a708-2a4eede584df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:31.888283 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdead5-e86a-4e1a-a708-2a4eede584df None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:31.896454 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 564/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:03:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:31.901900 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb9b8c-7f29-4948-a528-0c1a32e7a1a0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:31.935255 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:31.998126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb9b8c-7f29-4948-a528-0c1a32e7a1a0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:32.029712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990aea8-02d7-4e91-8189-dfcf91cf1ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:32.030561 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990aea8-02d7-4e91-8189-dfcf91cf1ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:32.030841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990aea8-02d7-4e91-8189-dfcf91cf1ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:32.031114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990aea8-02d7-4e91-8189-dfcf91cf1ef4 None admin] PATH_INFO: `/v3/users/014922ed9d50425da9d7f1687a5dd179` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:32.032262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990aea8-02d7-4e91-8189-dfcf91cf1ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=014922ed9d50425da9d7f1687a5dd179)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:32.033723 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990aea8-02d7-4e91-8189-dfcf91cf1ef4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:32.035300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 587/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:31 2022] GET /identity/v3/users/014922ed9d50425da9d7f1687a5dd179 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:32.040989 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdead5-e86a-4e1a-a708-2a4eede584df None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:32.052554 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:32.137310 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdead5-e86a-4e1a-a708-2a4eede584df None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:32.172117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d79f4-e156-4ab2-be0f-d18ed83ee6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:32.172987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d79f4-e156-4ab2-be0f-d18ed83ee6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:32.173271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d79f4-e156-4ab2-be0f-d18ed83ee6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:32.173548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d79f4-e156-4ab2-be0f-d18ed83ee6e3 None admin] PATH_INFO: `/v3/projects/d8c35f353c9041cdbecb0ba877fe773e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:32.175259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d79f4-e156-4ab2-be0f-d18ed83ee6e3 None admin] RBAC: Authorizing `identity:get_project(project_id=d8c35f353c9041cdbecb0ba877fe773e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:32.176689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d79f4-e156-4ab2-be0f-d18ed83ee6e3 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:32.178398 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 565/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:32 2022] GET /identity/v3/projects/d8c35f353c9041cdbecb0ba877fe773e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:32.184400 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990aea8-02d7-4e91-8189-dfcf91cf1ef4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:32.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990aea8-02d7-4e91-8189-dfcf91cf1ef4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:32.282987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:32.316120 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6acdf-105d-44dc-8646-9d2cd51c11f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:32.317040 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6acdf-105d-44dc-8646-9d2cd51c11f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:32.317325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6acdf-105d-44dc-8646-9d2cd51c11f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:32.317600 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6acdf-105d-44dc-8646-9d2cd51c11f9 None admin] PATH_INFO: `/v3/projects/d8c35f353c9041cdbecb0ba877fe773e/users/014922ed9d50425da9d7f1687a5dd179/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:32.319505 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6acdf-105d-44dc-8646-9d2cd51c11f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8c35f353c9041cdbecb0ba877fe773e, user_id=014922ed9d50425da9d7f1687a5dd179, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:32.321030 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6acdf-105d-44dc-8646-9d2cd51c11f9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:32.334098 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 588/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:03:32 2022] PUT /identity/v3/projects/d8c35f353c9041cdbecb0ba877fe773e/users/014922ed9d50425da9d7f1687a5dd179/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:03:34.293445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d145-5bbe-4001-b4c2-57efcb37bec0 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:34.293959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d145-5bbe-4001-b4c2-57efcb37bec0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:34.294071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d145-5bbe-4001-b4c2-57efcb37bec0 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:34.295616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 566/1154] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:34.300685 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611b8e1-c3aa-4456-8bab-77397f524fd2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:34.301095 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611b8e1-c3aa-4456-8bab-77397f524fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:34.301277 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611b8e1-c3aa-4456-8bab-77397f524fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:34.317574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4611b8e1-c3aa-4456-8bab-77397f524fd2 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:34.318731 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4611b8e1-c3aa-4456-8bab-77397f524fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:34.381719 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 589/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 10:03:34.405255 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44d145-5bbe-4001-b4c2-57efcb37bec0 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:34.479938 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:34.502705 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44d145-5bbe-4001-b4c2-57efcb37bec0 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:34.535024 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af5465-a2e3-4772-b617-4e4643031b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:34.535794 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af5465-a2e3-4772-b617-4e4643031b02 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:34.536074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af5465-a2e3-4772-b617-4e4643031b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:34.536346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af5465-a2e3-4772-b617-4e4643031b02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:34.546188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af5465-a2e3-4772-b617-4e4643031b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-81af5465-a2e3-4772-b617-4e4643031b02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:03:34.553621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:34.554693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:03:34.555902 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 567/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:03:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:34.560508 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611b8e1-c3aa-4456-8bab-77397f524fd2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:34.646661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:34.656376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611b8e1-c3aa-4456-8bab-77397f524fd2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:34.688188 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228d9bc-025d-414f-b6fe-a28a79d8061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:34.688837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d9bc-025d-414f-b6fe-a28a79d8061e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:34.689150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d9bc-025d-414f-b6fe-a28a79d8061e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:34.689423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228d9bc-025d-414f-b6fe-a28a79d8061e None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:34.690669 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228d9bc-025d-414f-b6fe-a28a79d8061e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:34.690974 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228d9bc-025d-414f-b6fe-a28a79d8061e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:34.692332 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228d9bc-025d-414f-b6fe-a28a79d8061e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:34.700004 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 590/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:03:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:34.706208 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af5465-a2e3-4772-b617-4e4643031b02 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:34.801910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af5465-a2e3-4772-b617-4e4643031b02 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:34.834154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4fa7b-a8b4-4e83-957a-c354c406978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:34.835075 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4fa7b-a8b4-4e83-957a-c354c406978a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:34.835359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4fa7b-a8b4-4e83-957a-c354c406978a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:34.835629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4fa7b-a8b4-4e83-957a-c354c406978a None admin] PATH_INFO: `/v3/users/014922ed9d50425da9d7f1687a5dd179` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:34.836786 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4fa7b-a8b4-4e83-957a-c354c406978a None admin] RBAC: Authorizing `identity:get_user(user_id=014922ed9d50425da9d7f1687a5dd179)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:34.838229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4fa7b-a8b4-4e83-957a-c354c406978a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:34.839814 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 568/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:34 2022] GET /identity/v3/users/014922ed9d50425da9d7f1687a5dd179 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:34.845227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228d9bc-025d-414f-b6fe-a28a79d8061e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:34.940988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228d9bc-025d-414f-b6fe-a28a79d8061e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:34.971928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289934ec-21c2-426a-909f-e3acc76009ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:34.972551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289934ec-21c2-426a-909f-e3acc76009ed None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:34.972832 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289934ec-21c2-426a-909f-e3acc76009ed None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:34.973132 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289934ec-21c2-426a-909f-e3acc76009ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:34.995849 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:35.039713 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289934ec-21c2-426a-909f-e3acc76009ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:35.041183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289934ec-21c2-426a-909f-e3acc76009ed None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:35.134287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 591/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:03:35.139917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4fa7b-a8b4-4e83-957a-c354c406978a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:35.144101 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:35.235783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4fa7b-a8b4-4e83-957a-c354c406978a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:35.267926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435605-003d-4846-b5a7-6594f53e479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:35.268764 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435605-003d-4846-b5a7-6594f53e479b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:35.269080 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435605-003d-4846-b5a7-6594f53e479b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:35.269351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435605-003d-4846-b5a7-6594f53e479b None admin] PATH_INFO: `/v3/projects/d8c35f353c9041cdbecb0ba877fe773e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:35.270499 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435605-003d-4846-b5a7-6594f53e479b None admin] RBAC: Authorizing `identity:get_project(project_id=d8c35f353c9041cdbecb0ba877fe773e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:35.271910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435605-003d-4846-b5a7-6594f53e479b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:35.273597 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 569/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:35 2022] GET /identity/v3/projects/d8c35f353c9041cdbecb0ba877fe773e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:35.279442 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289934ec-21c2-426a-909f-e3acc76009ed None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:35.333066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:35.376399 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289934ec-21c2-426a-909f-e3acc76009ed None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:35.409089 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972e429-4686-4f74-b642-71a6e4fef687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:35.409684 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972e429-4686-4f74-b642-71a6e4fef687 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:35.409971 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972e429-4686-4f74-b642-71a6e4fef687 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:35.410252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972e429-4686-4f74-b642-71a6e4fef687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:35.411067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972e429-4686-4f74-b642-71a6e4fef687 None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=d8c35f353c9041cdbecb0ba877fe773e, user.id=014922ed9d50425da9d7f1687a5dd179) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:35.411380 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972e429-4686-4f74-b642-71a6e4fef687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:35.412795 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972e429-4686-4f74-b642-71a6e4fef687 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:35.418543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 592/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:03:35 2022] GET /identity/v3/role_assignments?user.id=014922ed9d50425da9d7f1687a5dd179&scope.project.id=d8c35f353c9041cdbecb0ba877fe773e&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:37.436379 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d4439-c1f2-43ff-aec7-9faf0957565f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:37.436868 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d4439-c1f2-43ff-aec7-9faf0957565f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:37.437007 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d4439-c1f2-43ff-aec7-9faf0957565f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:37.438329 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 570/1162] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:37.443983 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ba20d-7458-478a-ba79-939c339ff8b6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:37.444411 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ba20d-7458-478a-ba79-939c339ff8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:37.444547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ba20d-7458-478a-ba79-939c339ff8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:37.460841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ff0ba20d-7458-478a-ba79-939c339ff8b6 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:37.462038 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ff0ba20d-7458-478a-ba79-939c339ff8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:37.524955 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 593/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:37.547164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d4439-c1f2-43ff-aec7-9faf0957565f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:37.616279 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:37.645541 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d4439-c1f2-43ff-aec7-9faf0957565f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:37.678366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3379b1c-b706-4a2f-a412-a2f9d57bee00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:37.678995 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3379b1c-b706-4a2f-a412-a2f9d57bee00 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:37.679278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3379b1c-b706-4a2f-a412-a2f9d57bee00 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:37.679555 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3379b1c-b706-4a2f-a412-a2f9d57bee00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:37.742536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3379b1c-b706-4a2f-a412-a2f9d57bee00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:37.743967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3379b1c-b706-4a2f-a412-a2f9d57bee00 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:37.813359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:37.842337 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 571/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:03:37.848708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ba20d-7458-478a-ba79-939c339ff8b6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:37.895103 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:37.943764 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ba20d-7458-478a-ba79-939c339ff8b6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:37.976597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c43fb-555d-4c9f-a4f4-b9ec9fb0e176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:37.977411 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c43fb-555d-4c9f-a4f4-b9ec9fb0e176 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:37.977697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c43fb-555d-4c9f-a4f4-b9ec9fb0e176 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:37.977977 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c43fb-555d-4c9f-a4f4-b9ec9fb0e176 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:37.984433 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c43fb-555d-4c9f-a4f4-b9ec9fb0e176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:37.985888 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c43fb-555d-4c9f-a4f4-b9ec9fb0e176 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e02c43fb-555d-4c9f-a4f4-b9ec9fb0e176 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:37.999660 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:38.000979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:38.002019 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 594/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 10:03:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:38.006557 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3379b1c-b706-4a2f-a412-a2f9d57bee00 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:38.102954 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3379b1c-b706-4a2f-a412-a2f9d57bee00 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:38.135181 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640f0e9-b3af-4416-be88-e7aa673a5620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:38.135832 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f0e9-b3af-4416-be88-e7aa673a5620 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:38.136116 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f0e9-b3af-4416-be88-e7aa673a5620 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:38.136392 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640f0e9-b3af-4416-be88-e7aa673a5620 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:38.137137 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640f0e9-b3af-4416-be88-e7aa673a5620 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:38.137447 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640f0e9-b3af-4416-be88-e7aa673a5620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:38.138826 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640f0e9-b3af-4416-be88-e7aa673a5620 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:38.146299 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 572/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Tue Jul 5 10:03:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:40.152291 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d32d6e-c49e-4610-a4fa-c7f7ac09112e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:40.152840 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d32d6e-c49e-4610-a4fa-c7f7ac09112e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:40.152840 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d32d6e-c49e-4610-a4fa-c7f7ac09112e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:40.154248 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 595/1167] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:40.159735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063e87-7193-440d-8b15-f6334107bf58 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:40.160168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063e87-7193-440d-8b15-f6334107bf58 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:40.160292 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063e87-7193-440d-8b15-f6334107bf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:40.178555 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-11063e87-7193-440d-8b15-f6334107bf58 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:40.179730 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-11063e87-7193-440d-8b15-f6334107bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:40.207334 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:40.244141 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 573/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:40.266907 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d32d6e-c49e-4610-a4fa-c7f7ac09112e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:40.366932 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d32d6e-c49e-4610-a4fa-c7f7ac09112e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:40.375645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:40.399906 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e88389-9b53-4466-9d91-0cf9efc390db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:40.400566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e88389-9b53-4466-9d91-0cf9efc390db None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:40.400854 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e88389-9b53-4466-9d91-0cf9efc390db None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:40.401162 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e88389-9b53-4466-9d91-0cf9efc390db None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:40.401909 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e88389-9b53-4466-9d91-0cf9efc390db None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:40.403323 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e88389-9b53-4466-9d91-0cf9efc390db None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:40.417498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 596/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Tue Jul 5 10:03:40 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:03:42.446825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddedc8b-7c25-4d77-9578-1b17f7273828 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:42.447329 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddedc8b-7c25-4d77-9578-1b17f7273828 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:42.447438 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddedc8b-7c25-4d77-9578-1b17f7273828 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:42.448742 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 574/1170] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:42.454047 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157629e-f741-477e-a23d-00e48d8bbebd None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:42.454451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157629e-f741-477e-a23d-00e48d8bbebd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:42.454611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157629e-f741-477e-a23d-00e48d8bbebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:42.472015 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d157629e-f741-477e-a23d-00e48d8bbebd None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:42.473234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d157629e-f741-477e-a23d-00e48d8bbebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:42.537493 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 597/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:42.560842 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddedc8b-7c25-4d77-9578-1b17f7273828 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:42.655542 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddedc8b-7c25-4d77-9578-1b17f7273828 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:42.687600 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470e788-bdd2-4f4a-96f5-a594c2bfdc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:42.688439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470e788-bdd2-4f4a-96f5-a594c2bfdc15 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:42.688719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470e788-bdd2-4f4a-96f5-a594c2bfdc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:42.689025 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470e788-bdd2-4f4a-96f5-a594c2bfdc15 None admin] PATH_INFO: `/v3/domains/6bdb3ef612ce403595880d3f7715966c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:42.698843 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470e788-bdd2-4f4a-96f5-a594c2bfdc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6bdb3ef612ce403595880d3f7715966c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:42.700266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470e788-bdd2-4f4a-96f5-a594c2bfdc15 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:42.701878 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 575/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Tue Jul 5 10:03:42 2022] GET /identity/v3/domains/6bdb3ef612ce403595880d3f7715966c => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:42.707867 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157629e-f741-477e-a23d-00e48d8bbebd None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:42.800080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:42.804113 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157629e-f741-477e-a23d-00e48d8bbebd None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:42.837619 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8876c-d273-4c9c-a000-23fbb997affa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:42.838221 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8876c-d273-4c9c-a000-23fbb997affa None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:42.838509 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8876c-d273-4c9c-a000-23fbb997affa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:42.838789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8876c-d273-4c9c-a000-23fbb997affa None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:42.839489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8876c-d273-4c9c-a000-23fbb997affa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:42.840933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8876c-d273-4c9c-a000-23fbb997affa None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:42.865265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 598/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:03:42 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:03:44.890148 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267bdb4-a9bc-45d7-84ca-39422fe5ed66 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:44.890698 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267bdb4-a9bc-45d7-84ca-39422fe5ed66 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:44.890698 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267bdb4-a9bc-45d7-84ca-39422fe5ed66 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:44.892077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 576/1174] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:44.897938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2517-91dc-43ad-bc28-c706a9dbf397 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:44.898338 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2517-91dc-43ad-bc28-c706a9dbf397 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:44.898507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2517-91dc-43ad-bc28-c706a9dbf397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:44.915288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-540d2517-91dc-43ad-bc28-c706a9dbf397 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:44.916450 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-540d2517-91dc-43ad-bc28-c706a9dbf397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:44.980016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 599/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:45.004305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267bdb4-a9bc-45d7-84ca-39422fe5ed66 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:45.031415 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:45.114731 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267bdb4-a9bc-45d7-84ca-39422fe5ed66 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:45.147243 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af61965-3cab-4659-aff6-725748b84336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:45.148035 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af61965-3cab-4659-aff6-725748b84336 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:45.148314 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af61965-3cab-4659-aff6-725748b84336 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:45.148607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af61965-3cab-4659-aff6-725748b84336 None admin] PATH_INFO: `/v3/domains/6bdb3ef612ce403595880d3f7715966c` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:45.149797 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af61965-3cab-4659-aff6-725748b84336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6bdb3ef612ce403595880d3f7715966c)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:45.151213 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af61965-3cab-4659-aff6-725748b84336 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:45.152808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 577/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Tue Jul 5 10:03:45 2022] GET /identity/v3/domains/6bdb3ef612ce403595880d3f7715966c => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:45.158684 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2517-91dc-43ad-bc28-c706a9dbf397 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:45.234502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:45.254175 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2517-91dc-43ad-bc28-c706a9dbf397 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:45.286284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ea0fc-dc4d-4e36-991a-d30a77501797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:45.286947 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ea0fc-dc4d-4e36-991a-d30a77501797 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:45.287228 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ea0fc-dc4d-4e36-991a-d30a77501797 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:45.287508 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ea0fc-dc4d-4e36-991a-d30a77501797 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:45.288220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ea0fc-dc4d-4e36-991a-d30a77501797 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:45.289661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ea0fc-dc4d-4e36-991a-d30a77501797 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:45.309274 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 600/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:03:45 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:03:47.357035 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee848437-2298-4d91-b2ad-c088c5ea6242 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:47.357581 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee848437-2298-4d91-b2ad-c088c5ea6242 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:47.357581 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee848437-2298-4d91-b2ad-c088c5ea6242 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:47.358960 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 578/1178] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:47.364096 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0245a-86e0-41cb-b4c1-b9816f98dd54 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:47.364525 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0245a-86e0-41cb-b4c1-b9816f98dd54 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:47.364667 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0245a-86e0-41cb-b4c1-b9816f98dd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:47.381730 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-81a0245a-86e0-41cb-b4c1-b9816f98dd54 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:47.382905 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-81a0245a-86e0-41cb-b4c1-b9816f98dd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 601/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:47.469737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee848437-2298-4d91-b2ad-c088c5ea6242 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:47.559045 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:47.566891 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee848437-2298-4d91-b2ad-c088c5ea6242 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:47.598917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854fe13-079b-4952-a439-74e2238dd4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:47.599688 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854fe13-079b-4952-a439-74e2238dd4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:47.599970 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854fe13-079b-4952-a439-74e2238dd4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:47.600243 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854fe13-079b-4952-a439-74e2238dd4b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:47.609850 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854fe13-079b-4952-a439-74e2238dd4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-d854fe13-079b-4952-a439-74e2238dd4b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:03:47.617442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:47.618587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:03:47.619896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 579/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:03:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:47.624555 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0245a-86e0-41cb-b4c1-b9816f98dd54 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:47.687090 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:47.720882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0245a-86e0-41cb-b4c1-b9816f98dd54 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:47.754226 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bf54c-480d-4678-a6fe-ed92e0465a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:47.754873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bf54c-480d-4678-a6fe-ed92e0465a43 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:47.755154 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bf54c-480d-4678-a6fe-ed92e0465a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:47.755428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bf54c-480d-4678-a6fe-ed92e0465a43 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:47.756159 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bf54c-480d-4678-a6fe-ed92e0465a43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:47.756462 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bf54c-480d-4678-a6fe-ed92e0465a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:47.757841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bf54c-480d-4678-a6fe-ed92e0465a43 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:47.765520 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 602/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:03:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:47.771108 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854fe13-079b-4952-a439-74e2238dd4b7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:47.867708 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854fe13-079b-4952-a439-74e2238dd4b7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:47.899396 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296b900-f044-4d91-9fcb-86ffd6407cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:47.900255 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296b900-f044-4d91-9fcb-86ffd6407cbd None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:47.900539 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296b900-f044-4d91-9fcb-86ffd6407cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:47.900816 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296b900-f044-4d91-9fcb-86ffd6407cbd None admin] PATH_INFO: `/v3/users/307925a3e5894fc5893cd84fc31f8ee1` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:47.914095 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296b900-f044-4d91-9fcb-86ffd6407cbd None admin] RBAC: Authorizing `identity:get_user(user_id=307925a3e5894fc5893cd84fc31f8ee1)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:47.915528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296b900-f044-4d91-9fcb-86ffd6407cbd None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:47.917187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 580/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:47 2022] GET /identity/v3/users/307925a3e5894fc5893cd84fc31f8ee1 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:47.922850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bf54c-480d-4678-a6fe-ed92e0465a43 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:48.017111 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bf54c-480d-4678-a6fe-ed92e0465a43 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:48.042835 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:48.051612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8b69e-4057-48c8-a93e-54b5a268f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:48.052253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8b69e-4057-48c8-a93e-54b5a268f352 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:48.052545 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8b69e-4057-48c8-a93e-54b5a268f352 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:48.052823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8b69e-4057-48c8-a93e-54b5a268f352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:48.117237 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8b69e-4057-48c8-a93e-54b5a268f352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:48.118708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8b69e-4057-48c8-a93e-54b5a268f352 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:48.212827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 603/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:03:48.218667 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296b900-f044-4d91-9fcb-86ffd6407cbd None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:48.232775 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:48.314406 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296b900-f044-4d91-9fcb-86ffd6407cbd None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:48.346972 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c2738-e77e-4772-ba29-c1f5ba281854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:48.347821 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c2738-e77e-4772-ba29-c1f5ba281854 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:48.348101 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c2738-e77e-4772-ba29-c1f5ba281854 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:48.348373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c2738-e77e-4772-ba29-c1f5ba281854 None admin] PATH_INFO: `/v3/projects/5c867c711e0f4e9fad3a396fdcb6391b` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:48.349528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c2738-e77e-4772-ba29-c1f5ba281854 None admin] RBAC: Authorizing `identity:get_project(project_id=5c867c711e0f4e9fad3a396fdcb6391b)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:48.350935 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c2738-e77e-4772-ba29-c1f5ba281854 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:48.352607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 581/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:48 2022] GET /identity/v3/projects/5c867c711e0f4e9fad3a396fdcb6391b => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:48.358640 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8b69e-4057-48c8-a93e-54b5a268f352 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:48.385465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:48.454371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8b69e-4057-48c8-a93e-54b5a268f352 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:48.487689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab629e-6be4-47f0-8297-f5618933230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:48.488337 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab629e-6be4-47f0-8297-f5618933230c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:48.488624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab629e-6be4-47f0-8297-f5618933230c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:48.488923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab629e-6be4-47f0-8297-f5618933230c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:48.489749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab629e-6be4-47f0-8297-f5618933230c None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=5c867c711e0f4e9fad3a396fdcb6391b, user.id=307925a3e5894fc5893cd84fc31f8ee1) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:48.490062 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab629e-6be4-47f0-8297-f5618933230c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:48.491475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab629e-6be4-47f0-8297-f5618933230c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:48.496681 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 604/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:03:48 2022] GET /identity/v3/role_assignments?user.id=307925a3e5894fc5893cd84fc31f8ee1&scope.project.id=5c867c711e0f4e9fad3a396fdcb6391b&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:50.473674 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460ae5b-73b5-44bb-b816-49c2fcef9483 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:50.474211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460ae5b-73b5-44bb-b816-49c2fcef9483 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:50.474211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460ae5b-73b5-44bb-b816-49c2fcef9483 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:50.475583 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 582/1186] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:50.480649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e86d09-0d68-48de-a5e6-41329625c06a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:50.481091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e86d09-0d68-48de-a5e6-41329625c06a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:50.481247 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e86d09-0d68-48de-a5e6-41329625c06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:50.497385 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-72e86d09-0d68-48de-a5e6-41329625c06a None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:50.498546 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-72e86d09-0d68-48de-a5e6-41329625c06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:50.562036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 605/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:50.584632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460ae5b-73b5-44bb-b816-49c2fcef9483 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:50.661841 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:50.681560 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460ae5b-73b5-44bb-b816-49c2fcef9483 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:50.713351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c0047-cbcf-4c27-86aa-d07aabf82a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:50.714125 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0047-cbcf-4c27-86aa-d07aabf82a2c None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:50.714406 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0047-cbcf-4c27-86aa-d07aabf82a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:50.714680 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0047-cbcf-4c27-86aa-d07aabf82a2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:50.724731 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c0047-cbcf-4c27-86aa-d07aabf82a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-a89c0047-cbcf-4c27-86aa-d07aabf82a2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:03:50.732245 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:50.733387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:03:50.734435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 583/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:50.739502 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e86d09-0d68-48de-a5e6-41329625c06a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:50.762421 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:50.834826 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e86d09-0d68-48de-a5e6-41329625c06a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:50.866762 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff65c7b-6fe2-40df-8fac-bc47930659b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:50.867414 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff65c7b-6fe2-40df-8fac-bc47930659b1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:50.867696 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff65c7b-6fe2-40df-8fac-bc47930659b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:50.867971 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff65c7b-6fe2-40df-8fac-bc47930659b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:50.868705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff65c7b-6fe2-40df-8fac-bc47930659b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:50.869202 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff65c7b-6fe2-40df-8fac-bc47930659b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:50.870562 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff65c7b-6fe2-40df-8fac-bc47930659b1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:50.878821 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 606/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:50.884326 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c0047-cbcf-4c27-86aa-d07aabf82a2c None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:50.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c0047-cbcf-4c27-86aa-d07aabf82a2c None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:51.010716 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9d65e-2e7d-4f7c-b33a-c05e1e882e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:51.011557 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9d65e-2e7d-4f7c-b33a-c05e1e882e02 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:51.011835 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9d65e-2e7d-4f7c-b33a-c05e1e882e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:51.012108 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9d65e-2e7d-4f7c-b33a-c05e1e882e02 None admin] PATH_INFO: `/v3/users/307925a3e5894fc5893cd84fc31f8ee1` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:51.013287 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9d65e-2e7d-4f7c-b33a-c05e1e882e02 None admin] RBAC: Authorizing `identity:get_user(user_id=307925a3e5894fc5893cd84fc31f8ee1)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:51.014699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9d65e-2e7d-4f7c-b33a-c05e1e882e02 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:51.016279 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 584/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:50 2022] GET /identity/v3/users/307925a3e5894fc5893cd84fc31f8ee1 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:51.022588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff65c7b-6fe2-40df-8fac-bc47930659b1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:51.104777 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:51.120827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff65c7b-6fe2-40df-8fac-bc47930659b1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:51.153305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2daee-23ed-4606-87e9-33ab1073280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:51.154142 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2daee-23ed-4606-87e9-33ab1073280e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:51.154425 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2daee-23ed-4606-87e9-33ab1073280e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:51.154698 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2daee-23ed-4606-87e9-33ab1073280e None admin] PATH_INFO: `/v3/projects/5c867c711e0f4e9fad3a396fdcb6391b` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:51.155850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2daee-23ed-4606-87e9-33ab1073280e None admin] RBAC: Authorizing `identity:get_project(project_id=5c867c711e0f4e9fad3a396fdcb6391b)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:51.157287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2daee-23ed-4606-87e9-33ab1073280e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:51.158963 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 607/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:51 2022] GET /identity/v3/projects/5c867c711e0f4e9fad3a396fdcb6391b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:51.164654 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9d65e-2e7d-4f7c-b33a-c05e1e882e02 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:51.175886 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:51.261019 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9d65e-2e7d-4f7c-b33a-c05e1e882e02 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:51.294280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4029c-bd47-44ff-961c-8c2682ae7519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:51.295174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4029c-bd47-44ff-961c-8c2682ae7519 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:51.295458 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4029c-bd47-44ff-961c-8c2682ae7519 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:51.296337 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4029c-bd47-44ff-961c-8c2682ae7519 None admin] PATH_INFO: `/v3/projects/5c867c711e0f4e9fad3a396fdcb6391b/users/307925a3e5894fc5893cd84fc31f8ee1/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:51.297974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4029c-bd47-44ff-961c-8c2682ae7519 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c867c711e0f4e9fad3a396fdcb6391b, user_id=307925a3e5894fc5893cd84fc31f8ee1, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:51.299436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4029c-bd47-44ff-961c-8c2682ae7519 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:51.311689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 585/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:03:51 2022] PUT /identity/v3/projects/5c867c711e0f4e9fad3a396fdcb6391b/users/307925a3e5894fc5893cd84fc31f8ee1/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:03:53.298271 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08df9d-a71f-4432-a9e6-e3f877ce9896 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:53.298662 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08df9d-a71f-4432-a9e6-e3f877ce9896 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:53.298874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08df9d-a71f-4432-a9e6-e3f877ce9896 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:53.300238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 608/1193] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:03:53.305303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf5b33-3758-4bc7-8515-f58ff12a2436 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:53.305721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf5b33-3758-4bc7-8515-f58ff12a2436 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:53.305873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf5b33-3758-4bc7-8515-f58ff12a2436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:53.322755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ecbf5b33-3758-4bc7-8515-f58ff12a2436 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:03:53.323942 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ecbf5b33-3758-4bc7-8515-f58ff12a2436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:03:53.383100 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:53.389425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 586/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:03:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:03:53.412607 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08df9d-a71f-4432-a9e6-e3f877ce9896 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:53.513414 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08df9d-a71f-4432-a9e6-e3f877ce9896 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:53.545541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced576c5-4e12-421e-845a-11d3f750a56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:53.546528 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced576c5-4e12-421e-845a-11d3f750a56e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:53.546816 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced576c5-4e12-421e-845a-11d3f750a56e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:53.547095 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced576c5-4e12-421e-845a-11d3f750a56e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:53.557683 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced576c5-4e12-421e-845a-11d3f750a56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ced576c5-4e12-421e-845a-11d3f750a56e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:03:53.565693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:03:53.566737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:03:53.567690 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 609/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:03:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:03:53.572884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf5b33-3758-4bc7-8515-f58ff12a2436 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:53.668055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf5b33-3758-4bc7-8515-f58ff12a2436 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:53.703050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551e15f-399d-4851-b20a-435760d50e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:53.703716 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551e15f-399d-4851-b20a-435760d50e56 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:53.704005 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551e15f-399d-4851-b20a-435760d50e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:53.704285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551e15f-399d-4851-b20a-435760d50e56 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:53.705081 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551e15f-399d-4851-b20a-435760d50e56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:53.705396 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551e15f-399d-4851-b20a-435760d50e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:53.706768 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551e15f-399d-4851-b20a-435760d50e56 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:53.714645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 587/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:03:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:53.720486 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced576c5-4e12-421e-845a-11d3f750a56e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:53.739314 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:53.823818 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced576c5-4e12-421e-845a-11d3f750a56e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:53.856294 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a5c6b-c37b-4b1d-883f-8ddece9df67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:53.857195 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a5c6b-c37b-4b1d-883f-8ddece9df67b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:53.857483 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a5c6b-c37b-4b1d-883f-8ddece9df67b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:53.857759 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a5c6b-c37b-4b1d-883f-8ddece9df67b None admin] PATH_INFO: `/v3/users/307925a3e5894fc5893cd84fc31f8ee1` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:53.858934 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a5c6b-c37b-4b1d-883f-8ddece9df67b None admin] RBAC: Authorizing `identity:get_user(user_id=307925a3e5894fc5893cd84fc31f8ee1)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:53.860356 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a5c6b-c37b-4b1d-883f-8ddece9df67b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:53.862506 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 610/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Tue Jul 5 10:03:53 2022] GET /identity/v3/users/307925a3e5894fc5893cd84fc31f8ee1 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:53.868378 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551e15f-399d-4851-b20a-435760d50e56 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:53.925900 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:53.964800 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551e15f-399d-4851-b20a-435760d50e56 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:53.996612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e49ea7-7848-4076-9d11-a9fcf6260899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:53.997276 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e49ea7-7848-4076-9d11-a9fcf6260899 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:53.997565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e49ea7-7848-4076-9d11-a9fcf6260899 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:53.997847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e49ea7-7848-4076-9d11-a9fcf6260899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:54.062682 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e49ea7-7848-4076-9d11-a9fcf6260899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:54.064123 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e49ea7-7848-4076-9d11-a9fcf6260899 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:54.119225 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:54.160201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 588/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:03:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:03:54.166035 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a5c6b-c37b-4b1d-883f-8ddece9df67b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:54.243503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:03:54.261979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a5c6b-c37b-4b1d-883f-8ddece9df67b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:54.295340 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f1697-1e23-4d7c-9600-57a1b896f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:54.296449 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f1697-1e23-4d7c-9600-57a1b896f4fa None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:54.296728 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f1697-1e23-4d7c-9600-57a1b896f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:54.297035 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f1697-1e23-4d7c-9600-57a1b896f4fa None admin] PATH_INFO: `/v3/projects/5c867c711e0f4e9fad3a396fdcb6391b` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:54.298186 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f1697-1e23-4d7c-9600-57a1b896f4fa None admin] RBAC: Authorizing `identity:get_project(project_id=5c867c711e0f4e9fad3a396fdcb6391b)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:54.300259 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f1697-1e23-4d7c-9600-57a1b896f4fa None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:54.301968 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 611/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Tue Jul 5 10:03:54 2022] GET /identity/v3/projects/5c867c711e0f4e9fad3a396fdcb6391b => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:03:54.307899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e49ea7-7848-4076-9d11-a9fcf6260899 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:03:54.400907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e49ea7-7848-4076-9d11-a9fcf6260899 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:03:54.444452 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158054df-6fc7-4236-a9e6-303f55a2396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:03:54.445138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158054df-6fc7-4236-a9e6-303f55a2396d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:03:54.445425 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158054df-6fc7-4236-a9e6-303f55a2396d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:03:54.445707 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158054df-6fc7-4236-a9e6-303f55a2396d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:03:54.446541 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158054df-6fc7-4236-a9e6-303f55a2396d None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=5c867c711e0f4e9fad3a396fdcb6391b, user.id=307925a3e5894fc5893cd84fc31f8ee1) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:03:54.446861 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158054df-6fc7-4236-a9e6-303f55a2396d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:03:54.448290 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158054df-6fc7-4236-a9e6-303f55a2396d None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:03:54.454050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 589/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:03:54 2022] GET /identity/v3/role_assignments?user.id=307925a3e5894fc5893cd84fc31f8ee1&scope.project.id=5c867c711e0f4e9fad3a396fdcb6391b&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:04:04.291176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=26 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:04.451387 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=88 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:49.513812 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aee52-0e6a-4611-9cd2-2782ec4a54bc None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:49.514408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aee52-0e6a-4611-9cd2-2782ec4a54bc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:49.514552 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aee52-0e6a-4611-9cd2-2782ec4a54bc None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:49.516299 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 612/1201] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:04:49.522867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af63f-68c1-4055-b691-c99feb9f14f0 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:49.523397 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af63f-68c1-4055-b691-c99feb9f14f0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:49.523397 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af63f-68c1-4055-b691-c99feb9f14f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:49.541424 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-fc2af63f-68c1-4055-b691-c99feb9f14f0 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:04:49.542767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fc2af63f-68c1-4055-b691-c99feb9f14f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:04:49.625765 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 590/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:04:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:04:49.652624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98aee52-0e6a-4611-9cd2-2782ec4a54bc None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:49.778751 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98aee52-0e6a-4611-9cd2-2782ec4a54bc None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:49.823589 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fe789-af69-482f-9dfd-5bcebb05a6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:49.824453 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fe789-af69-482f-9dfd-5bcebb05a6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:49.824775 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fe789-af69-482f-9dfd-5bcebb05a6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:49.825099 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fe789-af69-482f-9dfd-5bcebb05a6d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:49.837404 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fe789-af69-482f-9dfd-5bcebb05a6d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:49.838941 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fe789-af69-482f-9dfd-5bcebb05a6d9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-a19fe789-af69-482f-9dfd-5bcebb05a6d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:04:49.860461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:04:49.862231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:04:49.863307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:04:49.863307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:04:49.863307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:04:49.863307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:04:49.863307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 613/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:04:49.868432 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2af63f-68c1-4055-b691-c99feb9f14f0 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:50.013196 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2af63f-68c1-4055-b691-c99feb9f14f0 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:50.060857 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:50.068226 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e660741-c0a1-4c3d-93cc-34e6576c199f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:50.068926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e660741-c0a1-4c3d-93cc-34e6576c199f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:50.069286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e660741-c0a1-4c3d-93cc-34e6576c199f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:50.069464 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e660741-c0a1-4c3d-93cc-34e6576c199f None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:50.070186 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e660741-c0a1-4c3d-93cc-34e6576c199f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:50.070496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e660741-c0a1-4c3d-93cc-34e6576c199f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:50.071883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e660741-c0a1-4c3d-93cc-34e6576c199f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:50.083788 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 591/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:04:50.089343 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fe789-af69-482f-9dfd-5bcebb05a6d9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:50.162705 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:50.222137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fe789-af69-482f-9dfd-5bcebb05a6d9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:50.266846 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca739ee1-8df5-47e4-b8f1-a7817a52fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:50.267627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca739ee1-8df5-47e4-b8f1-a7817a52fbf1 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:50.267921 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca739ee1-8df5-47e4-b8f1-a7817a52fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:50.268219 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca739ee1-8df5-47e4-b8f1-a7817a52fbf1 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:50.268954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca739ee1-8df5-47e4-b8f1-a7817a52fbf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:50.270420 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca739ee1-8df5-47e4-b8f1-a7817a52fbf1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:50.301373 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 614/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Tue Jul 5 10:04:50 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:04:52.507311 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76c7b-d0b2-476f-8aac-7c306e926dab None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:52.508030 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76c7b-d0b2-476f-8aac-7c306e926dab None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:52.508030 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76c7b-d0b2-476f-8aac-7c306e926dab None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:52.509496 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 592/1206] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:04:52.514913 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eefa9f-4d07-43d8-9fe2-18f04c9c2814 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:52.515379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eefa9f-4d07-43d8-9fe2-18f04c9c2814 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:52.515479 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eefa9f-4d07-43d8-9fe2-18f04c9c2814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:52.533739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-26eefa9f-4d07-43d8-9fe2-18f04c9c2814 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:04:52.534938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-26eefa9f-4d07-43d8-9fe2-18f04c9c2814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:04:52.618207 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 615/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:04:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:04:52.643925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e76c7b-d0b2-476f-8aac-7c306e926dab None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:52.764168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e76c7b-d0b2-476f-8aac-7c306e926dab None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:52.807922 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cb19b-adb7-4fb5-81fe-e7312768ad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:52.808851 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb19b-adb7-4fb5-81fe-e7312768ad1e None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:52.809288 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb19b-adb7-4fb5-81fe-e7312768ad1e None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:52.809611 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb19b-adb7-4fb5-81fe-e7312768ad1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:52.823123 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cb19b-adb7-4fb5-81fe-e7312768ad1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-a77cb19b-adb7-4fb5-81fe-e7312768ad1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:04:52.831644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:04:52.832774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:04:52.833691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 593/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:04:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:04:52.839556 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eefa9f-4d07-43d8-9fe2-18f04c9c2814 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:52.881027 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:52.950327 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eefa9f-4d07-43d8-9fe2-18f04c9c2814 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:52.989894 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa70e4-881f-4aa8-8fe6-0e03c6965733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:52.990576 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa70e4-881f-4aa8-8fe6-0e03c6965733 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:52.990859 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa70e4-881f-4aa8-8fe6-0e03c6965733 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:52.991136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa70e4-881f-4aa8-8fe6-0e03c6965733 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:52.991873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa70e4-881f-4aa8-8fe6-0e03c6965733 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:52.992193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa70e4-881f-4aa8-8fe6-0e03c6965733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:52.993569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa70e4-881f-4aa8-8fe6-0e03c6965733 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:53.003137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 616/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:04:53.010394 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cb19b-adb7-4fb5-81fe-e7312768ad1e None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:53.070651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:53.126563 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cb19b-adb7-4fb5-81fe-e7312768ad1e None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:53.170531 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176044e-470c-4a0e-909b-8844c9f721a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:53.173274 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176044e-470c-4a0e-909b-8844c9f721a9 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:53.173274 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176044e-470c-4a0e-909b-8844c9f721a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:53.173274 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176044e-470c-4a0e-909b-8844c9f721a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:53.183847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176044e-470c-4a0e-909b-8844c9f721a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:53.185487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176044e-470c-4a0e-909b-8844c9f721a9 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-f176044e-470c-4a0e-909b-8844c9f721a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:04:53.203780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:04:53.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:04:53.206365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:04:53.206365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:04:53.206365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:04:53.206365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:04:53.206365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 594/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:04:53.211377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa70e4-881f-4aa8-8fe6-0e03c6965733 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:53.320350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:53.324768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa70e4-881f-4aa8-8fe6-0e03c6965733 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:53.362985 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52fadd-f1e0-4f38-9906-592a01ffcfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:53.363679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52fadd-f1e0-4f38-9906-592a01ffcfcd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:53.363968 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52fadd-f1e0-4f38-9906-592a01ffcfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:53.364304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52fadd-f1e0-4f38-9906-592a01ffcfcd None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:53.365178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52fadd-f1e0-4f38-9906-592a01ffcfcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:53.365524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52fadd-f1e0-4f38-9906-592a01ffcfcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:53.367121 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52fadd-f1e0-4f38-9906-592a01ffcfcd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:53.380843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 617/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:04:53.386907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176044e-470c-4a0e-909b-8844c9f721a9 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:53.504934 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176044e-470c-4a0e-909b-8844c9f721a9 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:53.506512 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:53.548807 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240e383-01d7-4b73-a2f0-4a01aa5bc091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:53.549819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240e383-01d7-4b73-a2f0-4a01aa5bc091 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:53.550099 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240e383-01d7-4b73-a2f0-4a01aa5bc091 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:53.550375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240e383-01d7-4b73-a2f0-4a01aa5bc091 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:53.558858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240e383-01d7-4b73-a2f0-4a01aa5bc091 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:53.560326 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240e383-01d7-4b73-a2f0-4a01aa5bc091 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-7240e383-01d7-4b73-a2f0-4a01aa5bc091 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:04:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:04:53.580959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:04:53.582050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:04:53.582050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:04:53.582050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:04:53.582050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:04:53.582050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:04:53.582050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:04:53.582050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:04:53.582050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:04:53.582050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:04:53.582050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:04:53.582050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 595/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:04:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:04:53.583625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52fadd-f1e0-4f38-9906-592a01ffcfcd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:53.699435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52fadd-f1e0-4f38-9906-592a01ffcfcd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:53.746612 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57ea96-7e76-4d81-9e8f-709d32da6d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:53.747308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57ea96-7e76-4d81-9e8f-709d32da6d62 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:53.747599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57ea96-7e76-4d81-9e8f-709d32da6d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:53.747874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57ea96-7e76-4d81-9e8f-709d32da6d62 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:53.748830 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57ea96-7e76-4d81-9e8f-709d32da6d62 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:53.749281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57ea96-7e76-4d81-9e8f-709d32da6d62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:53.750790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57ea96-7e76-4d81-9e8f-709d32da6d62 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:53.771524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 618/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 10:04:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:04:53.777665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240e383-01d7-4b73-a2f0-4a01aa5bc091 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:53.904562 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240e383-01d7-4b73-a2f0-4a01aa5bc091 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:53.947180 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb0b58-10fd-4cc3-b4c4-525362530764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:53.947841 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb0b58-10fd-4cc3-b4c4-525362530764 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:53.948128 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb0b58-10fd-4cc3-b4c4-525362530764 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:53.948404 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb0b58-10fd-4cc3-b4c4-525362530764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:53.988494 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:54.030891 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb0b58-10fd-4cc3-b4c4-525362530764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:54.032992 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb0b58-10fd-4cc3-b4c4-525362530764 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:54.150962 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 596/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:04:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:04:54.159665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57ea96-7e76-4d81-9e8f-709d32da6d62 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:54.181133 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:54.280131 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57ea96-7e76-4d81-9e8f-709d32da6d62 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:54.345957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005ac6-e627-4d5d-b61e-979280fd5027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:54.347049 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005ac6-e627-4d5d-b61e-979280fd5027 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:54.348435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005ac6-e627-4d5d-b61e-979280fd5027 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:54.348435 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005ac6-e627-4d5d-b61e-979280fd5027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:54.365275 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4005ac6-e627-4d5d-b61e-979280fd5027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:54.367267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4005ac6-e627-4d5d-b61e-979280fd5027 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e4005ac6-e627-4d5d-b61e-979280fd5027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:04:54.393797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:04:54.394879 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:04:54.395900 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:04:54.395900 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:04:54.395900 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:04:54.395900 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:04:54.396371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 619/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:04:54.402135 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb0b58-10fd-4cc3-b4c4-525362530764 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:54.475549 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:54.521673 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb0b58-10fd-4cc3-b4c4-525362530764 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:54.558606 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e9741-c2b6-4cff-8a61-d59a1da0d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:54.559246 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9741-c2b6-4cff-8a61-d59a1da0d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:54.559491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9741-c2b6-4cff-8a61-d59a1da0d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:54.559744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e9741-c2b6-4cff-8a61-d59a1da0d6f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:54.560464 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e9741-c2b6-4cff-8a61-d59a1da0d6f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:54.560779 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e9741-c2b6-4cff-8a61-d59a1da0d6f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:54.562188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e9741-c2b6-4cff-8a61-d59a1da0d6f7 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:54.576079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 597/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:04:54.582284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005ac6-e627-4d5d-b61e-979280fd5027 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:54.659232 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:54.698441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005ac6-e627-4d5d-b61e-979280fd5027 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:54.739948 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2005ae-dfa1-4015-b67b-b0eb5f886a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:54.740780 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2005ae-dfa1-4015-b67b-b0eb5f886a3c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:54.741094 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2005ae-dfa1-4015-b67b-b0eb5f886a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:54.741371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2005ae-dfa1-4015-b67b-b0eb5f886a3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:54.749091 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2005ae-dfa1-4015-b67b-b0eb5f886a3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:54.750538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2005ae-dfa1-4015-b67b-b0eb5f886a3c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-7c2005ae-dfa1-4015-b67b-b0eb5f886a3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:04:54.764387 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:04:54.765360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:04:54.771594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:04:54.771594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:04:54.771594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:04:54.771594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:04:54.771594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:04:54.771594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:04:54.771594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:04:54.771594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:04:54.771594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 620/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:04:54.772213 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e9741-c2b6-4cff-8a61-d59a1da0d6f7 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:54.888814 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e9741-c2b6-4cff-8a61-d59a1da0d6f7 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:54.919526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:54.934443 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f8122-2a50-4e49-8d0f-885ac9530bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:54.935127 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f8122-2a50-4e49-8d0f-885ac9530bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:54.935398 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f8122-2a50-4e49-8d0f-885ac9530bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:54.935676 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f8122-2a50-4e49-8d0f-885ac9530bb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:54.936491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f8122-2a50-4e49-8d0f-885ac9530bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:54.936804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f8122-2a50-4e49-8d0f-885ac9530bb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:54.938298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f8122-2a50-4e49-8d0f-885ac9530bb6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:54.951378 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 598/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:04:54.957811 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2005ae-dfa1-4015-b67b-b0eb5f886a3c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:55.098072 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2005ae-dfa1-4015-b67b-b0eb5f886a3c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:55.128129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:55.134569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e68409-9052-47ec-a5e5-7cfc9d6dd0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:55.135246 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e68409-9052-47ec-a5e5-7cfc9d6dd0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:55.135543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e68409-9052-47ec-a5e5-7cfc9d6dd0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:55.135834 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e68409-9052-47ec-a5e5-7cfc9d6dd0d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:55.136622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e68409-9052-47ec-a5e5-7cfc9d6dd0d6 None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=2df8f75ab3ab4468afdd39e7b8e4793f) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:55.136983 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e68409-9052-47ec-a5e5-7cfc9d6dd0d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:55.138402 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e68409-9052-47ec-a5e5-7cfc9d6dd0d6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:55.144279 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 621/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:04:54 2022] GET /identity/v3/role_assignments?user.id=2df8f75ab3ab4468afdd39e7b8e4793f&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:04:57.307440 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01fb17-9c0c-40c3-8b1a-763e30ffdd5b None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:57.307979 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01fb17-9c0c-40c3-8b1a-763e30ffdd5b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:57.308124 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01fb17-9c0c-40c3-8b1a-763e30ffdd5b None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:57.309476 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 599/1220] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:04:57.315199 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d780d-2b65-4a78-88ad-0a67fe51befe None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:57.316027 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d780d-2b65-4a78-88ad-0a67fe51befe None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:57.316370 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d780d-2b65-4a78-88ad-0a67fe51befe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:57.335366 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-477d780d-2b65-4a78-88ad-0a67fe51befe None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:04:57.336674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-477d780d-2b65-4a78-88ad-0a67fe51befe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:04:57.410743 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 622/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:04:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:04:57.435940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01fb17-9c0c-40c3-8b1a-763e30ffdd5b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:57.544781 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01fb17-9c0c-40c3-8b1a-763e30ffdd5b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:57.582655 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316782-e863-436d-a207-cd65eafb583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:57.583489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316782-e863-436d-a207-cd65eafb583d None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:57.583821 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316782-e863-436d-a207-cd65eafb583d None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:57.584091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316782-e863-436d-a207-cd65eafb583d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:57.595542 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f316782-e863-436d-a207-cd65eafb583d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-6f316782-e863-436d-a207-cd65eafb583d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:04:57.603958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:04:57.605102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:04:57.606185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 600/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:04:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:04:57.611982 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d780d-2b65-4a78-88ad-0a67fe51befe None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:57.715834 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d780d-2b65-4a78-88ad-0a67fe51befe None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:57.742683 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:57.754026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfe73d-2875-4e80-b417-0ef65fb1a91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:57.754694 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfe73d-2875-4e80-b417-0ef65fb1a91a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:57.754978 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfe73d-2875-4e80-b417-0ef65fb1a91a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:57.755253 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfe73d-2875-4e80-b417-0ef65fb1a91a None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:57.755988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfe73d-2875-4e80-b417-0ef65fb1a91a None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:57.756292 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfe73d-2875-4e80-b417-0ef65fb1a91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:57.757686 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfe73d-2875-4e80-b417-0ef65fb1a91a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:57.766385 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 623/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:04:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:04:57.772137 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316782-e863-436d-a207-cd65eafb583d None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:57.824411 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:57.883715 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316782-e863-436d-a207-cd65eafb583d None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:57.919364 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49894f90-b718-47ec-bab4-32507968e1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:57.920156 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49894f90-b718-47ec-bab4-32507968e1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:57.920441 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49894f90-b718-47ec-bab4-32507968e1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:57.920720 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49894f90-b718-47ec-bab4-32507968e1f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:57.931294 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49894f90-b718-47ec-bab4-32507968e1f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:57.932797 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49894f90-b718-47ec-bab4-32507968e1f6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-49894f90-b718-47ec-bab4-32507968e1f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:04:57.952071 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:04:57.953487 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:04:57.954827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:04:57.954827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:04:57.954827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:04:57.954827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:04:57.954827 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 601/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:04:57.959788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfe73d-2875-4e80-b417-0ef65fb1a91a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:58.076854 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfe73d-2875-4e80-b417-0ef65fb1a91a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:58.114577 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030e334-e398-46a4-88b1-e309569d87b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:58.115238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e334-e398-46a4-88b1-e309569d87b1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:58.115520 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e334-e398-46a4-88b1-e309569d87b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:58.115802 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e334-e398-46a4-88b1-e309569d87b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:58.118279 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030e334-e398-46a4-88b1-e309569d87b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:58.118678 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030e334-e398-46a4-88b1-e309569d87b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:58.120099 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030e334-e398-46a4-88b1-e309569d87b1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:58.132024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 624/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:04:58.138159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49894f90-b718-47ec-bab4-32507968e1f6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:58.236321 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:58.243114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49894f90-b718-47ec-bab4-32507968e1f6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:58.277638 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aa3f5-9b31-43d7-a573-f335779f4574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:58.278440 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa3f5-9b31-43d7-a573-f335779f4574 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:58.278724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa3f5-9b31-43d7-a573-f335779f4574 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:58.279000 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa3f5-9b31-43d7-a573-f335779f4574 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:58.288085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08aa3f5-9b31-43d7-a573-f335779f4574 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:58.288329 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08aa3f5-9b31-43d7-a573-f335779f4574 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-a08aa3f5-9b31-43d7-a573-f335779f4574 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:04:58.306015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:04:58.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:04:58.308691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:04:58.308691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:04:58.308691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:04:58.308691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:04:58.308691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:04:58.308691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:04:58.308691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:04:58.308691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:04:58.308691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:04:58.308691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:04:58.308691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 602/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:04:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:04:58.313221 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030e334-e398-46a4-88b1-e309569d87b1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:58.364852 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:58.421505 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030e334-e398-46a4-88b1-e309569d87b1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:58.460389 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11432bf-e8cb-4f9f-bf04-988aee4a18fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:58.461127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11432bf-e8cb-4f9f-bf04-988aee4a18fc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:58.461415 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11432bf-e8cb-4f9f-bf04-988aee4a18fc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:58.461695 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11432bf-e8cb-4f9f-bf04-988aee4a18fc None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:58.462535 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11432bf-e8cb-4f9f-bf04-988aee4a18fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:58.462892 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11432bf-e8cb-4f9f-bf04-988aee4a18fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:58.464453 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11432bf-e8cb-4f9f-bf04-988aee4a18fc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:58.482225 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 625/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 10:04:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:04:58.489009 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aa3f5-9b31-43d7-a573-f335779f4574 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:58.605791 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aa3f5-9b31-43d7-a573-f335779f4574 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:58.646958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6faf3c-3660-40f5-ba0d-a6519553488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:58.647871 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6faf3c-3660-40f5-ba0d-a6519553488b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:58.648165 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6faf3c-3660-40f5-ba0d-a6519553488b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:58.648472 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6faf3c-3660-40f5-ba0d-a6519553488b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:58.660565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6faf3c-3660-40f5-ba0d-a6519553488b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:58.662165 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6faf3c-3660-40f5-ba0d-a6519553488b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-ce6faf3c-3660-40f5-ba0d-a6519553488b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:04:58.684769 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:04:58.685883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:04:58.686925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:04:58.686925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:04:58.686925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:04:58.686925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:04:58.686925 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 603/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:04:58.692341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11432bf-e8cb-4f9f-bf04-988aee4a18fc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:58.805498 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11432bf-e8cb-4f9f-bf04-988aee4a18fc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:58.808039 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:58.843652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e82fd-5661-4403-80a8-c08c3edfd454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:58.844386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e82fd-5661-4403-80a8-c08c3edfd454 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:58.844706 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e82fd-5661-4403-80a8-c08c3edfd454 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:58.845530 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e82fd-5661-4403-80a8-c08c3edfd454 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:58.846325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e82fd-5661-4403-80a8-c08c3edfd454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:58.846634 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e82fd-5661-4403-80a8-c08c3edfd454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:58.848063 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e82fd-5661-4403-80a8-c08c3edfd454 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:58.860422 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 626/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:04:58.866700 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6faf3c-3660-40f5-ba0d-a6519553488b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:58.876541 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:58.978340 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6faf3c-3660-40f5-ba0d-a6519553488b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:59.016395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f281-04cd-45e7-83da-01e6fdc1bb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:59.017814 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f281-04cd-45e7-83da-01e6fdc1bb52 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:59.018164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f281-04cd-45e7-83da-01e6fdc1bb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:59.018466 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f281-04cd-45e7-83da-01e6fdc1bb52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:59.025814 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6f281-04cd-45e7-83da-01e6fdc1bb52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:59.027692 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6f281-04cd-45e7-83da-01e6fdc1bb52 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-cea6f281-04cd-45e7-83da-01e6fdc1bb52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:04:59.045234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:04:59.046485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:04:59.048037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:04:59.048037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:04:59.048037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:04:59.048037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:04:59.048037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:04:59.048037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:04:59.048037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:04:59.048037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:04:59.048037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 604/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:04:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:04:59.052745 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e82fd-5661-4403-80a8-c08c3edfd454 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:59.163746 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e82fd-5661-4403-80a8-c08c3edfd454 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:59.201683 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b86f1-6d27-410a-a4c3-2389aad55bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:59.202344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b86f1-6d27-410a-a4c3-2389aad55bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:59.202630 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b86f1-6d27-410a-a4c3-2389aad55bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:59.202908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b86f1-6d27-410a-a4c3-2389aad55bb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:59.203686 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b86f1-6d27-410a-a4c3-2389aad55bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:04:59.203999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b86f1-6d27-410a-a4c3-2389aad55bb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:59.205993 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b86f1-6d27-410a-a4c3-2389aad55bb9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:59.217885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 627/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:04:59.224783 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f281-04cd-45e7-83da-01e6fdc1bb52 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:04:59.300267 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:04:59.348585 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f281-04cd-45e7-83da-01e6fdc1bb52 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:04:59.384590 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b39f2-52fa-43a9-a503-28d053758587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:04:59.385570 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b39f2-52fa-43a9-a503-28d053758587 None admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:04:59.385852 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b39f2-52fa-43a9-a503-28d053758587 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:04:59.386126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b39f2-52fa-43a9-a503-28d053758587 None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/2df8f75ab3ab4468afdd39e7b8e4793f/roles/0fa7c8540d8b472aace10fb2fc38b37b` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:04:59.401736 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b39f2-52fa-43a9-a503-28d053758587 None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=2df8f75ab3ab4468afdd39e7b8e4793f, role_id=0fa7c8540d8b472aace10fb2fc38b37b)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:04:59.403460 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b39f2-52fa-43a9-a503-28d053758587 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:04:59.416819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 605/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:04:59 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/2df8f75ab3ab4468afdd39e7b8e4793f/roles/0fa7c8540d8b472aace10fb2fc38b37b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:05:01.560648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69965a8-dce0-4c70-9cc3-7ccbc6ef4942 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:01.561211 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69965a8-dce0-4c70-9cc3-7ccbc6ef4942 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:01.561318 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69965a8-dce0-4c70-9cc3-7ccbc6ef4942 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:01.562847 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 628/1233] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:05:01.568776 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7d29-4f25-4860-a190-d011e2857452 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:01.569230 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7d29-4f25-4860-a190-d011e2857452 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:01.569461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7d29-4f25-4860-a190-d011e2857452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:01.586669 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-03fc7d29-4f25-4860-a190-d011e2857452 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:05:01.587873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-03fc7d29-4f25-4860-a190-d011e2857452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:05:01.655940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 606/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:05:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:05:01.679571 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69965a8-dce0-4c70-9cc3-7ccbc6ef4942 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:01.705717 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:01.790905 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69965a8-dce0-4c70-9cc3-7ccbc6ef4942 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:01.826014 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07362684-d4b9-48ae-91c1-177a3c142713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:01.826747 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07362684-d4b9-48ae-91c1-177a3c142713 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:01.827033 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07362684-d4b9-48ae-91c1-177a3c142713 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:01.827314 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07362684-d4b9-48ae-91c1-177a3c142713 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:01.838926 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07362684-d4b9-48ae-91c1-177a3c142713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-07362684-d4b9-48ae-91c1-177a3c142713 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:05:01.848988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:01.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:01.851689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 629/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Tue Jul 5 10:05:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:01.856583 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc7d29-4f25-4860-a190-d011e2857452 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:01.906542 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:01.971887 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc7d29-4f25-4860-a190-d011e2857452 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:02.007671 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f6057-cb70-413d-9bd3-961b199041e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:02.008396 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f6057-cb70-413d-9bd3-961b199041e4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:02.008686 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f6057-cb70-413d-9bd3-961b199041e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:02.008998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f6057-cb70-413d-9bd3-961b199041e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:02.009755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f6057-cb70-413d-9bd3-961b199041e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:02.010066 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f6057-cb70-413d-9bd3-961b199041e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:02.011439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f6057-cb70-413d-9bd3-961b199041e4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:02.020445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 607/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Tue Jul 5 10:05:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:02.026417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07362684-d4b9-48ae-91c1-177a3c142713 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:02.131008 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:02.149344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07362684-d4b9-48ae-91c1-177a3c142713 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:02.188360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ff9f3-c2b6-41ff-bf44-07c58f9d2209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:02.189382 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff9f3-c2b6-41ff-bf44-07c58f9d2209 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:02.189723 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff9f3-c2b6-41ff-bf44-07c58f9d2209 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:02.190109 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff9f3-c2b6-41ff-bf44-07c58f9d2209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:02.200753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ff9f3-c2b6-41ff-bf44-07c58f9d2209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:02.202240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ff9f3-c2b6-41ff-bf44-07c58f9d2209 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-219ff9f3-c2b6-41ff-bf44-07c58f9d2209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:05:02.221880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:02.223325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:02.224227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:05:02.224227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:05:02.224227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:02.224227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:02.224227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 630/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:02.229317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f6057-cb70-413d-9bd3-961b199041e4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:02.346301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f6057-cb70-413d-9bd3-961b199041e4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:02.356277 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:02.389268 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6657f7-504a-4a4a-b12a-9e15828b5cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:02.390067 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6657f7-504a-4a4a-b12a-9e15828b5cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:02.390388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6657f7-504a-4a4a-b12a-9e15828b5cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:02.390882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6657f7-504a-4a4a-b12a-9e15828b5cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:02.391652 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6657f7-504a-4a4a-b12a-9e15828b5cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:02.391988 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6657f7-504a-4a4a-b12a-9e15828b5cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:02.393621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6657f7-504a-4a4a-b12a-9e15828b5cd6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:02.414274 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 608/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:02.415470 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ff9f3-c2b6-41ff-bf44-07c58f9d2209 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:02.526227 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ff9f3-c2b6-41ff-bf44-07c58f9d2209 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:02.565232 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f4886-11c4-4fba-9a70-65a21cfff2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:02.566115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4886-11c4-4fba-9a70-65a21cfff2eb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:02.566429 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4886-11c4-4fba-9a70-65a21cfff2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:02.566775 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4886-11c4-4fba-9a70-65a21cfff2eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:02.569762 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:02.575425 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f4886-11c4-4fba-9a70-65a21cfff2eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:02.577406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f4886-11c4-4fba-9a70-65a21cfff2eb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-117f4886-11c4-4fba-9a70-65a21cfff2eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:05:02.593957 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:02.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:02.596760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:02.596760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:02.596760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:05:02.596760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:05:02.596760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:05:02.596760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:05:02.596760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:05:02.596760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:05:02.596760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:05:02.596760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:02.596760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 631/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:02.601531 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6657f7-504a-4a4a-b12a-9e15828b5cd6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:02.719460 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6657f7-504a-4a4a-b12a-9e15828b5cd6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:02.755381 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c184903-0129-462a-a28e-15a499cfba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:02.756046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c184903-0129-462a-a28e-15a499cfba95 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:02.756328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c184903-0129-462a-a28e-15a499cfba95 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:02.756602 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c184903-0129-462a-a28e-15a499cfba95 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:02.757464 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c184903-0129-462a-a28e-15a499cfba95 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:02.757774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c184903-0129-462a-a28e-15a499cfba95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:02.759193 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c184903-0129-462a-a28e-15a499cfba95 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:02.777507 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 609/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 10:05:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:02.783875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f4886-11c4-4fba-9a70-65a21cfff2eb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:02.892476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f4886-11c4-4fba-9a70-65a21cfff2eb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:02.933782 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12ba92-63e4-40a5-9c84-c643a3a822e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:02.934578 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ba92-63e4-40a5-9c84-c643a3a822e1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:02.934875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ba92-63e4-40a5-9c84-c643a3a822e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:02.935235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ba92-63e4-40a5-9c84-c643a3a822e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:03.008076 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:03.017271 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12ba92-63e4-40a5-9c84-c643a3a822e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:03.018927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12ba92-63e4-40a5-9c84-c643a3a822e1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:03.137933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 632/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:05:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:03.144321 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c184903-0129-462a-a28e-15a499cfba95 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:03.174940 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:03.257801 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c184903-0129-462a-a28e-15a499cfba95 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:03.298930 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799bf11-de18-414f-9ead-f2bd04140b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:03.299926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799bf11-de18-414f-9ead-f2bd04140b76 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:03.300307 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799bf11-de18-414f-9ead-f2bd04140b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:03.300655 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799bf11-de18-414f-9ead-f2bd04140b76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:03.312585 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799bf11-de18-414f-9ead-f2bd04140b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:03.314075 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799bf11-de18-414f-9ead-f2bd04140b76 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-e799bf11-de18-414f-9ead-f2bd04140b76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:05:03.334629 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:03.335862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:03.337232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:05:03.337232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:05:03.337232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:03.337232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:03.337232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 610/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 10:05:03.341902 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12ba92-63e4-40a5-9c84-c643a3a822e1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:03.448977 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:03.457082 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12ba92-63e4-40a5-9c84-c643a3a822e1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:03.498701 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda775e3-8099-4ef9-a176-f7cfe7b0bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:03.499554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda775e3-8099-4ef9-a176-f7cfe7b0bf9e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:03.499828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda775e3-8099-4ef9-a176-f7cfe7b0bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:03.500111 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda775e3-8099-4ef9-a176-f7cfe7b0bf9e None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:03.500843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda775e3-8099-4ef9-a176-f7cfe7b0bf9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:03.501740 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda775e3-8099-4ef9-a176-f7cfe7b0bf9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:03.503126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda775e3-8099-4ef9-a176-f7cfe7b0bf9e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:03.521580 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 633/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:03.522921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799bf11-de18-414f-9ead-f2bd04140b76 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:03.614966 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:03.638562 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799bf11-de18-414f-9ead-f2bd04140b76 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:03.673771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a1036-3fe7-49cf-9af6-139155fe2849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:03.674566 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a1036-3fe7-49cf-9af6-139155fe2849 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:03.674849 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a1036-3fe7-49cf-9af6-139155fe2849 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:03.675122 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a1036-3fe7-49cf-9af6-139155fe2849 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:03.681663 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a1036-3fe7-49cf-9af6-139155fe2849 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:03.683096 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a1036-3fe7-49cf-9af6-139155fe2849 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1b8a1036-3fe7-49cf-9af6-139155fe2849 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:05:03.698001 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:03.698921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:03.705461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:05:03.705461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:05:03.705461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:05:03.705461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:05:03.705461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:05:03.705461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:05:03.705461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:05:03.705461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:03.705461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 611/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:05:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:03.706060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda775e3-8099-4ef9-a176-f7cfe7b0bf9e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:03.810126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda775e3-8099-4ef9-a176-f7cfe7b0bf9e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:03.846422 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3738a8-021f-424a-bfdc-124c2a6d9f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:03.847122 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3738a8-021f-424a-bfdc-124c2a6d9f3a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:03.847436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3738a8-021f-424a-bfdc-124c2a6d9f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:03.847732 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3738a8-021f-424a-bfdc-124c2a6d9f3a None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:03.848602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3738a8-021f-424a-bfdc-124c2a6d9f3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:03.848935 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3738a8-021f-424a-bfdc-124c2a6d9f3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:03.850371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3738a8-021f-424a-bfdc-124c2a6d9f3a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:03.862963 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 634/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:05:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:05:03.868591 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a1036-3fe7-49cf-9af6-139155fe2849 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:03.981125 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a1036-3fe7-49cf-9af6-139155fe2849 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:04.019766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f76d88-21d7-4da7-9c38-71c37a7deae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:04.020508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f76d88-21d7-4da7-9c38-71c37a7deae6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:04.020793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f76d88-21d7-4da7-9c38-71c37a7deae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:04.021109 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f76d88-21d7-4da7-9c38-71c37a7deae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:04.022155 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f76d88-21d7-4da7-9c38-71c37a7deae6 None admin] RBAC: Adding query filter params (role.id=0fa7c8540d8b472aace10fb2fc38b37b, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=2df8f75ab3ab4468afdd39e7b8e4793f) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:04.022528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f76d88-21d7-4da7-9c38-71c37a7deae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:04.024303 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f76d88-21d7-4da7-9c38-71c37a7deae6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:04.031268 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 612/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:05:03 2022] GET /identity/v3/role_assignments?user.id=2df8f75ab3ab4468afdd39e7b8e4793f&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=0fa7c8540d8b472aace10fb2fc38b37b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:06.516790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d0362-4bb6-4a7a-a912-12828b0b09b9 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:06.517357 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d0362-4bb6-4a7a-a912-12828b0b09b9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:06.517476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d0362-4bb6-4a7a-a912-12828b0b09b9 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:06.519249 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 635/1247] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:05:06.525353 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aee097-16a2-47e5-8010-15010a7a6f3c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:06.525916 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aee097-16a2-47e5-8010-15010a7a6f3c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:06.526091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aee097-16a2-47e5-8010-15010a7a6f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:06.531362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:06.544359 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-50aee097-16a2-47e5-8010-15010a7a6f3c None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:05:06.545903 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-50aee097-16a2-47e5-8010-15010a7a6f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:05:06.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 613/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:05:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:05:06.650523 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d0362-4bb6-4a7a-a912-12828b0b09b9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:06.669341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:06.768499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d0362-4bb6-4a7a-a912-12828b0b09b9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:06.805283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48c7f0-20d4-4ec8-a765-b1972139fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:06.805991 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c7f0-20d4-4ec8-a765-b1972139fcae None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:06.806273 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c7f0-20d4-4ec8-a765-b1972139fcae None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:06.806553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c7f0-20d4-4ec8-a765-b1972139fcae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:06.817336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48c7f0-20d4-4ec8-a765-b1972139fcae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0f48c7f0-20d4-4ec8-a765-b1972139fcae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:05:06.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:06.826127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:06.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 636/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:06.832146 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aee097-16a2-47e5-8010-15010a7a6f3c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:06.940660 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aee097-16a2-47e5-8010-15010a7a6f3c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:06.974756 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:06.980542 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0377fb6-9735-4a0c-9367-b1d1547a6145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:06.981826 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0377fb6-9735-4a0c-9367-b1d1547a6145 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:06.982187 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0377fb6-9735-4a0c-9367-b1d1547a6145 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:06.982508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0377fb6-9735-4a0c-9367-b1d1547a6145 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:06.983502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0377fb6-9735-4a0c-9367-b1d1547a6145 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:06.983826 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0377fb6-9735-4a0c-9367-b1d1547a6145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:06.985281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0377fb6-9735-4a0c-9367-b1d1547a6145 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:06.995823 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 614/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:07.001756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48c7f0-20d4-4ec8-a765-b1972139fcae None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:07.094025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:07.121148 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48c7f0-20d4-4ec8-a765-b1972139fcae None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:07.159629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba485f-727b-47af-8498-2d41a704123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:07.160623 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba485f-727b-47af-8498-2d41a704123a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:07.160997 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba485f-727b-47af-8498-2d41a704123a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:07.161332 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba485f-727b-47af-8498-2d41a704123a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:07.175054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba485f-727b-47af-8498-2d41a704123a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:07.176719 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba485f-727b-47af-8498-2d41a704123a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-77ba485f-727b-47af-8498-2d41a704123a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:05:07.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:07.198102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:07.199130 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:05:07.199130 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:05:07.199130 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:07.199130 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:07.202895 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 637/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:07.203939 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0377fb6-9735-4a0c-9367-b1d1547a6145 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:07.322939 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0377fb6-9735-4a0c-9367-b1d1547a6145 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:07.367178 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b43d8-2d38-4d62-83fb-5da983e09c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:07.368120 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b43d8-2d38-4d62-83fb-5da983e09c81 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:07.368466 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b43d8-2d38-4d62-83fb-5da983e09c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:07.368788 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b43d8-2d38-4d62-83fb-5da983e09c81 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:07.369742 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b43d8-2d38-4d62-83fb-5da983e09c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:07.370124 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b43d8-2d38-4d62-83fb-5da983e09c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:07.372044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b43d8-2d38-4d62-83fb-5da983e09c81 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:07.386268 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 615/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:07.393409 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba485f-727b-47af-8498-2d41a704123a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:07.509446 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba485f-727b-47af-8498-2d41a704123a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:07.540615 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:07.550291 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e24d19-9cd0-486a-81ab-fbfd51f8d29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:07.551141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e24d19-9cd0-486a-81ab-fbfd51f8d29b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:07.551467 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e24d19-9cd0-486a-81ab-fbfd51f8d29b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:07.551800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e24d19-9cd0-486a-81ab-fbfd51f8d29b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:07.560615 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e24d19-9cd0-486a-81ab-fbfd51f8d29b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:07.562104 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e24d19-9cd0-486a-81ab-fbfd51f8d29b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-f0e24d19-9cd0-486a-81ab-fbfd51f8d29b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:05:07.580564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:07.581676 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:07.583058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:07.583058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:07.583058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:05:07.583058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:05:07.583058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:05:07.583058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:05:07.583058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:05:07.583058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:05:07.583058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:05:07.583058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:07.583058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 638/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:07.588269 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b43d8-2d38-4d62-83fb-5da983e09c81 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:07.652524 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:07.705831 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b43d8-2d38-4d62-83fb-5da983e09c81 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:07.747074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a17394-69e4-4b5a-9ae6-b491b33c8526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:07.747775 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a17394-69e4-4b5a-9ae6-b491b33c8526 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:07.748130 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a17394-69e4-4b5a-9ae6-b491b33c8526 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:07.748481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a17394-69e4-4b5a-9ae6-b491b33c8526 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:07.749388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a17394-69e4-4b5a-9ae6-b491b33c8526 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:07.749702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a17394-69e4-4b5a-9ae6-b491b33c8526 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:07.751896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a17394-69e4-4b5a-9ae6-b491b33c8526 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:07.773928 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 616/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 10:05:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:07.779845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e24d19-9cd0-486a-81ab-fbfd51f8d29b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:07.885163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e24d19-9cd0-486a-81ab-fbfd51f8d29b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:07.923606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefb62a-80fb-41a9-a2dc-bb8b0d5eb3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:07.924191 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb62a-80fb-41a9-a2dc-bb8b0d5eb3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:07.924481 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb62a-80fb-41a9-a2dc-bb8b0d5eb3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:07.924757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb62a-80fb-41a9-a2dc-bb8b0d5eb3a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:07.988524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:08.003807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefb62a-80fb-41a9-a2dc-bb8b0d5eb3a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:08.005301 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefb62a-80fb-41a9-a2dc-bb8b0d5eb3a9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:08.121481 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 639/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:05:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 10:05:08.127954 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a17394-69e4-4b5a-9ae6-b491b33c8526 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:08.236096 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a17394-69e4-4b5a-9ae6-b491b33c8526 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:08.250232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:08.273912 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423829b-c43e-4503-91fc-fee1e949aa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:08.274719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423829b-c43e-4503-91fc-fee1e949aa0b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:08.275000 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423829b-c43e-4503-91fc-fee1e949aa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:08.275267 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423829b-c43e-4503-91fc-fee1e949aa0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:08.288324 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423829b-c43e-4503-91fc-fee1e949aa0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:08.290037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423829b-c43e-4503-91fc-fee1e949aa0b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-2423829b-c43e-4503-91fc-fee1e949aa0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:05:08.315118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:08.316252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:08.321793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:05:08.321793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:05:08.321793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:08.321793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:08.321793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 617/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:08.322079 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefb62a-80fb-41a9-a2dc-bb8b0d5eb3a9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:08.411953 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:08.428360 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefb62a-80fb-41a9-a2dc-bb8b0d5eb3a9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:08.470923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e2c88-12e4-4276-bcb7-57a41ca5d7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:08.471601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e2c88-12e4-4276-bcb7-57a41ca5d7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:08.471870 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e2c88-12e4-4276-bcb7-57a41ca5d7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:08.472147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e2c88-12e4-4276-bcb7-57a41ca5d7e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:08.472866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e2c88-12e4-4276-bcb7-57a41ca5d7e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:08.473188 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e2c88-12e4-4276-bcb7-57a41ca5d7e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:08.474537 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e2c88-12e4-4276-bcb7-57a41ca5d7e1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:08.487094 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 640/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:08.492641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423829b-c43e-4503-91fc-fee1e949aa0b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:08.600462 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423829b-c43e-4503-91fc-fee1e949aa0b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:08.636754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6b974-fc3e-4a7a-984b-030c7950eb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:08.639207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6b974-fc3e-4a7a-984b-030c7950eb75 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:08.639536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6b974-fc3e-4a7a-984b-030c7950eb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:08.639814 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6b974-fc3e-4a7a-984b-030c7950eb75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:08.647168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6b974-fc3e-4a7a-984b-030c7950eb75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:08.648689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6b974-fc3e-4a7a-984b-030c7950eb75 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-1ea6b974-fc3e-4a7a-984b-030c7950eb75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:05:08.662332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:08.663413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:08.669418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:05:08.669418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:05:08.669418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:05:08.669418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:05:08.669418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:05:08.669418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:05:08.669418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:05:08.669418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:08.669418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 618/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:08.669999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e2c88-12e4-4276-bcb7-57a41ca5d7e1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:08.780649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e2c88-12e4-4276-bcb7-57a41ca5d7e1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:08.821067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d422a-3ebf-4286-aa0a-4dd6aca688b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:08.821737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d422a-3ebf-4286-aa0a-4dd6aca688b8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:08.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d422a-3ebf-4286-aa0a-4dd6aca688b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:08.822309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d422a-3ebf-4286-aa0a-4dd6aca688b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:08.823094 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d422a-3ebf-4286-aa0a-4dd6aca688b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:08.823415 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d422a-3ebf-4286-aa0a-4dd6aca688b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:08.824862 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d422a-3ebf-4286-aa0a-4dd6aca688b8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:08.840726 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 641/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:08.846665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6b974-fc3e-4a7a-984b-030c7950eb75 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:08.874587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:08.955097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6b974-fc3e-4a7a-984b-030c7950eb75 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:08.991944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cd8b6-f9f6-453c-98bb-fb0d295f883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:08.992698 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cd8b6-f9f6-453c-98bb-fb0d295f883f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:08.993018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cd8b6-f9f6-453c-98bb-fb0d295f883f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:08.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cd8b6-f9f6-453c-98bb-fb0d295f883f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:08.994131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cd8b6-f9f6-453c-98bb-fb0d295f883f None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=2df8f75ab3ab4468afdd39e7b8e4793f) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:08.994443 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cd8b6-f9f6-453c-98bb-fb0d295f883f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:08.995877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cd8b6-f9f6-453c-98bb-fb0d295f883f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:09.002333 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 619/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:05:08 2022] GET /identity/v3/role_assignments?user.id=2df8f75ab3ab4468afdd39e7b8e4793f&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:11.014813 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7c5d5-f619-4bb3-8741-fdb080184d3b None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:11.015362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7c5d5-f619-4bb3-8741-fdb080184d3b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:11.015362 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7c5d5-f619-4bb3-8741-fdb080184d3b None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:11.016787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 642/1261] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:05:11.021885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b293bf-2a1d-491a-b714-8ea95bf1754f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:11.022298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b293bf-2a1d-491a-b714-8ea95bf1754f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:11.022449 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b293bf-2a1d-491a-b714-8ea95bf1754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:11.039584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-00b293bf-2a1d-491a-b714-8ea95bf1754f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:05:11.040811 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-00b293bf-2a1d-491a-b714-8ea95bf1754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:05:11.108385 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 620/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:05:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:05:11.132665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7c5d5-f619-4bb3-8741-fdb080184d3b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:11.143600 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:11.230885 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7c5d5-f619-4bb3-8741-fdb080184d3b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:11.263760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fdd71-a98a-4756-84d5-fe831c380090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:11.264535 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fdd71-a98a-4756-84d5-fe831c380090 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:11.264866 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fdd71-a98a-4756-84d5-fe831c380090 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:11.265126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fdd71-a98a-4756-84d5-fe831c380090 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:11.275344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fdd71-a98a-4756-84d5-fe831c380090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0f4fdd71-a98a-4756-84d5-fe831c380090 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:05:11.283617 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:11.284697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:11.287233 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 643/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:05:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:11.290853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b293bf-2a1d-491a-b714-8ea95bf1754f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:11.309417 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:11.388226 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b293bf-2a1d-491a-b714-8ea95bf1754f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:11.420780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2153b-ba66-4132-9b7d-f31c36d33b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:11.421477 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2153b-ba66-4132-9b7d-f31c36d33b96 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:11.421767 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2153b-ba66-4132-9b7d-f31c36d33b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:11.422054 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2153b-ba66-4132-9b7d-f31c36d33b96 None admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:11.423084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2153b-ba66-4132-9b7d-f31c36d33b96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:11.423394 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2153b-ba66-4132-9b7d-f31c36d33b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:11.424759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2153b-ba66-4132-9b7d-f31c36d33b96 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:11.432763 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 621/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:05:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:11.439055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fdd71-a98a-4756-84d5-fe831c380090 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:11.504094 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:11.536965 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fdd71-a98a-4756-84d5-fe831c380090 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:11.569139 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746beaec-3ae4-4aaf-afb3-db6efbc7a6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:11.569925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746beaec-3ae4-4aaf-afb3-db6efbc7a6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:11.570210 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746beaec-3ae4-4aaf-afb3-db6efbc7a6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:11.570489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746beaec-3ae4-4aaf-afb3-db6efbc7a6f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:11.581242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746beaec-3ae4-4aaf-afb3-db6efbc7a6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:11.582675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746beaec-3ae4-4aaf-afb3-db6efbc7a6f9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-746beaec-3ae4-4aaf-afb3-db6efbc7a6f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:05:11.599141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:11.600150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:11.601112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:05:11.601112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:05:11.601112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:11.601112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:11.601112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 644/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:11.606226 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2153b-ba66-4132-9b7d-f31c36d33b96 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:11.683700 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:11.702500 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2153b-ba66-4132-9b7d-f31c36d33b96 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:11.736193 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d42dc1-4d3f-440f-b23c-17a4e2ef75eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:11.736868 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d42dc1-4d3f-440f-b23c-17a4e2ef75eb None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:11.737177 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d42dc1-4d3f-440f-b23c-17a4e2ef75eb None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:11.737550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d42dc1-4d3f-440f-b23c-17a4e2ef75eb None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:11.738661 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d42dc1-4d3f-440f-b23c-17a4e2ef75eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:11.738661 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d42dc1-4d3f-440f-b23c-17a4e2ef75eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:11.739835 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d42dc1-4d3f-440f-b23c-17a4e2ef75eb None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:11.752264 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 622/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:11.758039 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746beaec-3ae4-4aaf-afb3-db6efbc7a6f9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:11.853170 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746beaec-3ae4-4aaf-afb3-db6efbc7a6f9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:11.872158 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:11.886280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94d736-5a46-465a-ac55-f06fb92800cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:11.887073 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d736-5a46-465a-ac55-f06fb92800cb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:11.887361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d736-5a46-465a-ac55-f06fb92800cb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:11.887641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d736-5a46-465a-ac55-f06fb92800cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:11.894932 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94d736-5a46-465a-ac55-f06fb92800cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:11.896361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94d736-5a46-465a-ac55-f06fb92800cb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-8f94d736-5a46-465a-ac55-f06fb92800cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:05:11.910267 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:11.911334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:11.912652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:11.912652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:11.912652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:05:11.912652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:05:11.912652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:05:11.912652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:05:11.912652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:05:11.912652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:05:11.912652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:05:11.912652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:11.912652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 645/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:11.917217 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d42dc1-4d3f-440f-b23c-17a4e2ef75eb None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:12.014138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d42dc1-4d3f-440f-b23c-17a4e2ef75eb None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:12.049471 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ae407-2998-42bc-83a5-6c41c879e0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:12.059076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ae407-2998-42bc-83a5-6c41c879e0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:12.059076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ae407-2998-42bc-83a5-6c41c879e0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:12.059076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ae407-2998-42bc-83a5-6c41c879e0d6 None admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:12.059076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ae407-2998-42bc-83a5-6c41c879e0d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:12.059076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ae407-2998-42bc-83a5-6c41c879e0d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:12.059076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ae407-2998-42bc-83a5-6c41c879e0d6 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:12.064733 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:12.074074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 623/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 10:05:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:12.079929 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94d736-5a46-465a-ac55-f06fb92800cb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:12.179592 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94d736-5a46-465a-ac55-f06fb92800cb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:12.211390 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2539b-96cc-42d7-b968-00b61b7a775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:12.212166 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2539b-96cc-42d7-b968-00b61b7a775a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:12.212452 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2539b-96cc-42d7-b968-00b61b7a775a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:12.212732 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2539b-96cc-42d7-b968-00b61b7a775a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:12.223551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2539b-96cc-42d7-b968-00b61b7a775a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:12.225005 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2539b-96cc-42d7-b968-00b61b7a775a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-97e2539b-96cc-42d7-b968-00b61b7a775a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:05:12.242176 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:12.243244 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:12.244171 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:05:12.244171 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:05:12.244171 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:12.244171 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:12.244171 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 646/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:12.248910 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ae407-2998-42bc-83a5-6c41c879e0d6 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:12.344329 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ae407-2998-42bc-83a5-6c41c879e0d6 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:12.379021 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d5a6b-02ce-4909-8081-51b018b5855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:12.379702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d5a6b-02ce-4909-8081-51b018b5855a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:12.379988 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d5a6b-02ce-4909-8081-51b018b5855a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:12.380265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d5a6b-02ce-4909-8081-51b018b5855a None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:12.381003 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d5a6b-02ce-4909-8081-51b018b5855a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:12.381312 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d5a6b-02ce-4909-8081-51b018b5855a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:12.382668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d5a6b-02ce-4909-8081-51b018b5855a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:12.393410 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 624/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:12.399031 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2539b-96cc-42d7-b968-00b61b7a775a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:12.430766 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:12.496007 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2539b-96cc-42d7-b968-00b61b7a775a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:12.527991 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815146c5-ba4b-4853-b7c9-e652d03e4ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:12.528767 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815146c5-ba4b-4853-b7c9-e652d03e4ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:12.529083 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815146c5-ba4b-4853-b7c9-e652d03e4ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:12.529364 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815146c5-ba4b-4853-b7c9-e652d03e4ce5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:12.536462 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815146c5-ba4b-4853-b7c9-e652d03e4ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:12.537930 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815146c5-ba4b-4853-b7c9-e652d03e4ce5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-815146c5-ba4b-4853-b7c9-e652d03e4ce5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:05:12.552126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:12.553317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:12.554624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:05:12.554624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:05:12.554624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:05:12.554624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:05:12.554624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:05:12.554624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:05:12.554624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:05:12.554624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:12.554624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 647/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:12.558936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d5a6b-02ce-4909-8081-51b018b5855a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:12.614914 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:12.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d5a6b-02ce-4909-8081-51b018b5855a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:12.686710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c978ad6-7e3b-4abb-92e7-a4b5a2c3e285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:12.687296 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c978ad6-7e3b-4abb-92e7-a4b5a2c3e285 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:12.687575 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c978ad6-7e3b-4abb-92e7-a4b5a2c3e285 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:12.687848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c978ad6-7e3b-4abb-92e7-a4b5a2c3e285 None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:12.688618 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c978ad6-7e3b-4abb-92e7-a4b5a2c3e285 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:12.688946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c978ad6-7e3b-4abb-92e7-a4b5a2c3e285 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:12.690368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c978ad6-7e3b-4abb-92e7-a4b5a2c3e285 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:12.701713 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 625/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:12.708261 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815146c5-ba4b-4853-b7c9-e652d03e4ce5 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:12.795769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:12.805262 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815146c5-ba4b-4853-b7c9-e652d03e4ce5 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:12.837638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd935d-3475-4cad-91ec-a9b3079c97dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:12.838505 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd935d-3475-4cad-91ec-a9b3079c97dc None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:12.838787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd935d-3475-4cad-91ec-a9b3079c97dc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:12.839059 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd935d-3475-4cad-91ec-a9b3079c97dc None admin] PATH_INFO: `/v3/projects/b44e947a29a74df6acde7e008f714b04/users/2df8f75ab3ab4468afdd39e7b8e4793f/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:12.840985 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd935d-3475-4cad-91ec-a9b3079c97dc None admin] RBAC: Authorizing `identity:create_grant(project_id=b44e947a29a74df6acde7e008f714b04, user_id=2df8f75ab3ab4468afdd39e7b8e4793f, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:12.842708 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd935d-3475-4cad-91ec-a9b3079c97dc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:12.855101 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 648/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Tue Jul 5 10:05:12 2022] PUT /identity/v3/projects/b44e947a29a74df6acde7e008f714b04/users/2df8f75ab3ab4468afdd39e7b8e4793f/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:05:14.834015 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae069a5-93ad-47c2-b170-8678498d6676 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:14.834527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae069a5-93ad-47c2-b170-8678498d6676 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:14.834647 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae069a5-93ad-47c2-b170-8678498d6676 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:14.835926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 626/1274] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:05:14.841084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b7b43-612c-4141-b143-731759911dad None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:14.841450 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b7b43-612c-4141-b143-731759911dad None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:14.841650 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b7b43-612c-4141-b143-731759911dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:14.859036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b20b7b43-612c-4141-b143-731759911dad None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:05:14.860213 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b20b7b43-612c-4141-b143-731759911dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:05:14.924569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 649/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:05:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:05:14.947204 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae069a5-93ad-47c2-b170-8678498d6676 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:15.054378 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae069a5-93ad-47c2-b170-8678498d6676 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:15.073951 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:15.090859 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cf218-8e3a-4d08-be4b-4f001db51488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:15.091590 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cf218-8e3a-4d08-be4b-4f001db51488 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:15.091873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cf218-8e3a-4d08-be4b-4f001db51488 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:15.092144 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cf218-8e3a-4d08-be4b-4f001db51488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:15.101858 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cf218-8e3a-4d08-be4b-4f001db51488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-7b5cf218-8e3a-4d08-be4b-4f001db51488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 10:05:15.109528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:15.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:15.111511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 627/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Tue Jul 5 10:05:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:15.116703 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b7b43-612c-4141-b143-731759911dad None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:15.195470 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:15.213942 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b7b43-612c-4141-b143-731759911dad None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:15.245943 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d28e54-b633-4145-ad88-40b0cb12b7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:15.246606 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d28e54-b633-4145-ad88-40b0cb12b7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:15.246903 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d28e54-b633-4145-ad88-40b0cb12b7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:15.247188 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d28e54-b633-4145-ad88-40b0cb12b7f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:15.247932 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d28e54-b633-4145-ad88-40b0cb12b7f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:15.248242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d28e54-b633-4145-ad88-40b0cb12b7f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:15.249634 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d28e54-b633-4145-ad88-40b0cb12b7f7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:15.257954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 650/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Tue Jul 5 10:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:15.263535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cf218-8e3a-4d08-be4b-4f001db51488 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:15.360094 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cf218-8e3a-4d08-be4b-4f001db51488 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:15.392847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71305446-7718-4d18-b0fb-5da07bfa774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:15.393653 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305446-7718-4d18-b0fb-5da07bfa774b None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:15.393934 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305446-7718-4d18-b0fb-5da07bfa774b None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:15.394210 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305446-7718-4d18-b0fb-5da07bfa774b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:15.404351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71305446-7718-4d18-b0fb-5da07bfa774b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:15.405822 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71305446-7718-4d18-b0fb-5da07bfa774b None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-71305446-7718-4d18-b0fb-5da07bfa774b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:05:15.422579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:15.424034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:15.424959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:05:15.424959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:05:15.424959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:15.424959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:15.424959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 628/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:15.430122 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d28e54-b633-4145-ad88-40b0cb12b7f7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:15.526652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d28e54-b633-4145-ad88-40b0cb12b7f7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:15.559385 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8e6f1-7394-4623-a624-cfcf0fbf8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:15.560036 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8e6f1-7394-4623-a624-cfcf0fbf8165 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:15.560325 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8e6f1-7394-4623-a624-cfcf0fbf8165 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:15.560605 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8e6f1-7394-4623-a624-cfcf0fbf8165 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:15.561374 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8e6f1-7394-4623-a624-cfcf0fbf8165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:15.561686 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8e6f1-7394-4623-a624-cfcf0fbf8165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:15.563041 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8e6f1-7394-4623-a624-cfcf0fbf8165 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:15.574394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 651/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:15.580363 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71305446-7718-4d18-b0fb-5da07bfa774b None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:15.610366 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:15.676853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71305446-7718-4d18-b0fb-5da07bfa774b None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:15.708671 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308ce61-a683-4e2d-997c-bc8a469013b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:15.709476 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308ce61-a683-4e2d-997c-bc8a469013b4 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:15.709760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308ce61-a683-4e2d-997c-bc8a469013b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:15.710036 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308ce61-a683-4e2d-997c-bc8a469013b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:15.717134 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308ce61-a683-4e2d-997c-bc8a469013b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:15.718562 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308ce61-a683-4e2d-997c-bc8a469013b4 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-3308ce61-a683-4e2d-997c-bc8a469013b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 10:05:15.732927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:15.734052 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:15.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:15.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:15.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 10:05:15.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 10:05:15.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 10:05:15.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 10:05:15.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 10:05:15.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 10:05:15.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 10:05:15.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:15.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 629/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:15.739803 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8e6f1-7394-4623-a624-cfcf0fbf8165 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:15.743492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:15.835621 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8e6f1-7394-4623-a624-cfcf0fbf8165 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:15.867590 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b94854-e16a-4153-9677-b0e90e5f3c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:15.868182 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b94854-e16a-4153-9677-b0e90e5f3c8a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:15.868464 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b94854-e16a-4153-9677-b0e90e5f3c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:15.868739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b94854-e16a-4153-9677-b0e90e5f3c8a None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:15.869583 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b94854-e16a-4153-9677-b0e90e5f3c8a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:15.869891 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b94854-e16a-4153-9677-b0e90e5f3c8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:15.871300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b94854-e16a-4153-9677-b0e90e5f3c8a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:15.887928 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 652/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Tue Jul 5 10:05:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:15.894099 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308ce61-a683-4e2d-997c-bc8a469013b4 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:15.982497 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:15.991953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308ce61-a683-4e2d-997c-bc8a469013b4 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:16.024484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24f59f-2ecb-455f-8c02-ab0fc32bb16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:16.025145 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24f59f-2ecb-455f-8c02-ab0fc32bb16f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:16.025480 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24f59f-2ecb-455f-8c02-ab0fc32bb16f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:16.025759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24f59f-2ecb-455f-8c02-ab0fc32bb16f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:16.093782 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24f59f-2ecb-455f-8c02-ab0fc32bb16f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:16.095266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24f59f-2ecb-455f-8c02-ab0fc32bb16f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:16.179806 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:16.190627 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 630/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Tue Jul 5 10:05:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:16.196326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b94854-e16a-4153-9677-b0e90e5f3c8a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:16.254997 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:16.291510 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b94854-e16a-4153-9677-b0e90e5f3c8a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:16.325514 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde00686-4e90-4d72-986c-1387fba6a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:16.326304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00686-4e90-4d72-986c-1387fba6a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:16.326595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00686-4e90-4d72-986c-1387fba6a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:16.326874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00686-4e90-4d72-986c-1387fba6a2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:16.336623 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde00686-4e90-4d72-986c-1387fba6a2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:16.338084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde00686-4e90-4d72-986c-1387fba6a2a4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-bde00686-4e90-4d72-986c-1387fba6a2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 10:05:16.355055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:16.356115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:16.357252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 10:05:16.357252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 10:05:16.357252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 10:05:16.357252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:16.357252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 653/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:16.362503 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24f59f-2ecb-455f-8c02-ab0fc32bb16f None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:16.457855 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24f59f-2ecb-455f-8c02-ab0fc32bb16f None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:16.490272 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92f063-c1d2-4ad6-946a-3f7df72b9ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:16.490927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92f063-c1d2-4ad6-946a-3f7df72b9ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:16.491221 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92f063-c1d2-4ad6-946a-3f7df72b9ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:16.491503 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92f063-c1d2-4ad6-946a-3f7df72b9ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:16.492221 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92f063-c1d2-4ad6-946a-3f7df72b9ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:16.492530 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92f063-c1d2-4ad6-946a-3f7df72b9ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:16.493928 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92f063-c1d2-4ad6-946a-3f7df72b9ae9 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:16.505280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 631/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Tue Jul 5 10:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:16.510814 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde00686-4e90-4d72-986c-1387fba6a2a4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:16.606940 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde00686-4e90-4d72-986c-1387fba6a2a4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:16.620493 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:16.641341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea9736-b5f5-405d-b58e-b520b87168fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:16.642796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea9736-b5f5-405d-b58e-b520b87168fb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:16.643077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea9736-b5f5-405d-b58e-b520b87168fb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:16.643353 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea9736-b5f5-405d-b58e-b520b87168fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:16.650049 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea9736-b5f5-405d-b58e-b520b87168fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:16.651491 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea9736-b5f5-405d-b58e-b520b87168fb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-a8ea9736-b5f5-405d-b58e-b520b87168fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 10:05:16.665028 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:16.666053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:16.667163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 10:05:16.667163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 10:05:16.667163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 10:05:16.667163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 10:05:16.667163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 10:05:16.667163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 10:05:16.667163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 10:05:16.667163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 05 10:05:16.667163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 654/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Tue Jul 5 10:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:16.672078 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92f063-c1d2-4ad6-946a-3f7df72b9ae9 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:16.721035 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:16.769865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92f063-c1d2-4ad6-946a-3f7df72b9ae9 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:16.803163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cc662-d501-4d1b-9590-eb0b00f5812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:16.803808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cc662-d501-4d1b-9590-eb0b00f5812f None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:16.804099 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cc662-d501-4d1b-9590-eb0b00f5812f None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:16.804381 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cc662-d501-4d1b-9590-eb0b00f5812f None admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:16.805195 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cc662-d501-4d1b-9590-eb0b00f5812f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:16.805509 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cc662-d501-4d1b-9590-eb0b00f5812f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:16.806935 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cc662-d501-4d1b-9590-eb0b00f5812f None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:16.818511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 632/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Tue Jul 5 10:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:16.824290 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea9736-b5f5-405d-b58e-b520b87168fb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:16.920806 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea9736-b5f5-405d-b58e-b520b87168fb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:16.953209 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220d589-1fc0-4b6c-a9f6-6f126d9e8319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:16.953846 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220d589-1fc0-4b6c-a9f6-6f126d9e8319 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:16.954654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220d589-1fc0-4b6c-a9f6-6f126d9e8319 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:16.954938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220d589-1fc0-4b6c-a9f6-6f126d9e8319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:16.955755 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220d589-1fc0-4b6c-a9f6-6f126d9e8319 None admin] RBAC: Adding query filter params (role.id=4650ad8552cd4c5f96701ea7e3bea401, scope.project.id=b44e947a29a74df6acde7e008f714b04, user.id=2df8f75ab3ab4468afdd39e7b8e4793f) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:16.956074 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220d589-1fc0-4b6c-a9f6-6f126d9e8319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:16.957527 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220d589-1fc0-4b6c-a9f6-6f126d9e8319 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:16.963208 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 655/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Tue Jul 5 10:05:16 2022] GET /identity/v3/role_assignments?user.id=2df8f75ab3ab4468afdd39e7b8e4793f&scope.project.id=b44e947a29a74df6acde7e008f714b04&role.id=4650ad8552cd4c5f96701ea7e3bea401 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:18.989384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591dfc3-7a65-4c6a-9ae7-df8dfbf10392 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:18.989974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591dfc3-7a65-4c6a-9ae7-df8dfbf10392 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:18.989974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591dfc3-7a65-4c6a-9ae7-df8dfbf10392 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:18.991323 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 633/1288] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:05:18.996507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da78643-1af2-450a-979d-1e1763037d98 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:18.996933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da78643-1af2-450a-979d-1e1763037d98 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:18.997096 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da78643-1af2-450a-979d-1e1763037d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:19.013255 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-3da78643-1af2-450a-979d-1e1763037d98 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:05:19.014421 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3da78643-1af2-450a-979d-1e1763037d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:05:19.047035 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:19.095832 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 656/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:05:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:05:19.121212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591dfc3-7a65-4c6a-9ae7-df8dfbf10392 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:19.217695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591dfc3-7a65-4c6a-9ae7-df8dfbf10392 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:19.228254 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:19.251163 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f5ca4-c511-4b3d-afe5-261fcf1f4c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:19.251953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f5ca4-c511-4b3d-afe5-261fcf1f4c5a None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:19.252241 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f5ca4-c511-4b3d-afe5-261fcf1f4c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:19.252519 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f5ca4-c511-4b3d-afe5-261fcf1f4c5a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:19.253186 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f5ca4-c511-4b3d-afe5-261fcf1f4c5a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:19.254547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f5ca4-c511-4b3d-afe5-261fcf1f4c5a None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-073f5ca4-c511-4b3d-afe5-261fcf1f4c5a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:19.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:19.267879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:19.268818 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 634/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 10:05:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:19.273964 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da78643-1af2-450a-979d-1e1763037d98 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:19.368796 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da78643-1af2-450a-979d-1e1763037d98 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:19.400910 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d928dd5-f258-4da0-978b-e19aa8b3e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:19.401575 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d928dd5-f258-4da0-978b-e19aa8b3e914 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:19.401858 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d928dd5-f258-4da0-978b-e19aa8b3e914 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:19.402131 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d928dd5-f258-4da0-978b-e19aa8b3e914 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:19.402823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d928dd5-f258-4da0-978b-e19aa8b3e914 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:19.403127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d928dd5-f258-4da0-978b-e19aa8b3e914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:19.404481 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d928dd5-f258-4da0-978b-e19aa8b3e914 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:19.409810 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 657/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Jul 5 10:05:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:19.415454 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f5ca4-c511-4b3d-afe5-261fcf1f4c5a None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:19.510963 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f5ca4-c511-4b3d-afe5-261fcf1f4c5a None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:19.542888 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab23c1-e963-4dde-9d25-44d66a259895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:19.543525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab23c1-e963-4dde-9d25-44d66a259895 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:19.543807 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab23c1-e963-4dde-9d25-44d66a259895 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:19.544082 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab23c1-e963-4dde-9d25-44d66a259895 None admin] PATH_INFO: `/v3/services` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:19.544770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab23c1-e963-4dde-9d25-44d66a259895 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:19.545105 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab23c1-e963-4dde-9d25-44d66a259895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:19.546455 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab23c1-e963-4dde-9d25-44d66a259895 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:19.550961 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 635/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Jul 5 10:05:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:21.531485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b5f43-ae4d-42c3-a1ae-b5a16c52b644 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:21.532020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b5f43-ae4d-42c3-a1ae-b5a16c52b644 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:21.532020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b5f43-ae4d-42c3-a1ae-b5a16c52b644 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:21.533467 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 658/1293] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:05:21.538514 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1295c-ebf3-49f5-9a56-00485bbd3f18 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:21.538913 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1295c-ebf3-49f5-9a56-00485bbd3f18 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:21.539063 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1295c-ebf3-49f5-9a56-00485bbd3f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:21.555928 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e1d1295c-ebf3-49f5-9a56-00485bbd3f18 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:05:21.557064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e1d1295c-ebf3-49f5-9a56-00485bbd3f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:05:21.585270 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:21.620563 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 636/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:05:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:05:21.643748 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b5f43-ae4d-42c3-a1ae-b5a16c52b644 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:21.674359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:21.742127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b5f43-ae4d-42c3-a1ae-b5a16c52b644 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:21.775541 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1fda4-fcb2-44d4-abd9-6fc6e512458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:21.776190 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1fda4-fcb2-44d4-abd9-6fc6e512458e None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:21.776472 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1fda4-fcb2-44d4-abd9-6fc6e512458e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:21.776745 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1fda4-fcb2-44d4-abd9-6fc6e512458e None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:21.777476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1fda4-fcb2-44d4-abd9-6fc6e512458e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:21.778833 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1fda4-fcb2-44d4-abd9-6fc6e512458e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:21.791933 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 659/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Tue Jul 5 10:05:21 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:05:23.785332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a5e73-0222-4922-95ff-3b1fd23cbd0f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:23.785873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a5e73-0222-4922-95ff-3b1fd23cbd0f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:23.785873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a5e73-0222-4922-95ff-3b1fd23cbd0f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:23.787264 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 637/1296] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:05:23.792241 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236733ed-fe4f-4603-85a6-910e54aa5eb2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:23.792654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236733ed-fe4f-4603-85a6-910e54aa5eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:23.792802 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236733ed-fe4f-4603-85a6-910e54aa5eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:23.809787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-236733ed-fe4f-4603-85a6-910e54aa5eb2 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:05:23.810959 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-236733ed-fe4f-4603-85a6-910e54aa5eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:05:23.881228 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 660/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:05:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:05:23.903276 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a5e73-0222-4922-95ff-3b1fd23cbd0f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:24.000543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a5e73-0222-4922-95ff-3b1fd23cbd0f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:24.034634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80480580-f4f2-4f5a-9a45-a820b2e8bb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:24.035624 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480580-f4f2-4f5a-9a45-a820b2e8bb99 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:24.035749 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480580-f4f2-4f5a-9a45-a820b2e8bb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:24.035970 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480580-f4f2-4f5a-9a45-a820b2e8bb99 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:24.036610 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80480580-f4f2-4f5a-9a45-a820b2e8bb99 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:24.038224 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80480580-f4f2-4f5a-9a45-a820b2e8bb99 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-80480580-f4f2-4f5a-9a45-a820b2e8bb99 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:24.050936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:24.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:24.053157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 638/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 10:05:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:24.058470 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236733ed-fe4f-4603-85a6-910e54aa5eb2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:24.081931 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:24.163367 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236733ed-fe4f-4603-85a6-910e54aa5eb2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:24.195874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a5198-5605-4ca3-9764-af6e029123dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:24.196530 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a5198-5605-4ca3-9764-af6e029123dc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:24.196814 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a5198-5605-4ca3-9764-af6e029123dc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:24.197123 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a5198-5605-4ca3-9764-af6e029123dc None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:24.197821 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a5198-5605-4ca3-9764-af6e029123dc None admin] RBAC: Adding query filter params (name=placement) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:24.198128 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a5198-5605-4ca3-9764-af6e029123dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:24.199484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a5198-5605-4ca3-9764-af6e029123dc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:24.205142 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 661/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Jul 5 10:05:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:24.211011 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80480580-f4f2-4f5a-9a45-a820b2e8bb99 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:24.240854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:24.307899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80480580-f4f2-4f5a-9a45-a820b2e8bb99 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:24.339224 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2cf7a-f918-437b-bb28-87a93524c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:24.339866 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2cf7a-f918-437b-bb28-87a93524c233 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:24.340146 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2cf7a-f918-437b-bb28-87a93524c233 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:24.340419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2cf7a-f918-437b-bb28-87a93524c233 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:24.341226 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2cf7a-f918-437b-bb28-87a93524c233 None admin] RBAC: Adding query filter params (interface=public, service_id=6996a8e0a20341b880bcd05d45430ade, region_id=RegionOne) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:24.341535 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2cf7a-f918-437b-bb28-87a93524c233 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:24.342888 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2cf7a-f918-437b-bb28-87a93524c233 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:24.348192 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 639/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Tue Jul 5 10:05:24 2022] GET /identity/v3/endpoints?service_id=6996a8e0a20341b880bcd05d45430ade&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:24.353724 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a5198-5605-4ca3-9764-af6e029123dc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:24.432629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:24.450257 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a5198-5605-4ca3-9764-af6e029123dc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:24.483140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0156ea-d712-4d2c-b745-44aedb806a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:24.483800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0156ea-d712-4d2c-b745-44aedb806a62 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:24.484084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0156ea-d712-4d2c-b745-44aedb806a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:24.484361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0156ea-d712-4d2c-b745-44aedb806a62 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:24.485067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0156ea-d712-4d2c-b745-44aedb806a62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:24.486458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0156ea-d712-4d2c-b745-44aedb806a62 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:24.493137 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 662/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Tue Jul 5 10:05:24 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:05:26.494990 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4f48e-1f41-4ed9-82a4-a8374fbd1fb2 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:26.495533 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4f48e-1f41-4ed9-82a4-a8374fbd1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:26.495533 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4f48e-1f41-4ed9-82a4-a8374fbd1fb2 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:26.496946 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 640/1302] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:05:26.502214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb61b-e0bb-43fe-9fd1-6ddf96739171 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:26.502631 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb61b-e0bb-43fe-9fd1-6ddf96739171 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:26.502775 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb61b-e0bb-43fe-9fd1-6ddf96739171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:26.518971 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-50afb61b-e0bb-43fe-9fd1-6ddf96739171 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:05:26.520150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-50afb61b-e0bb-43fe-9fd1-6ddf96739171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:05:26.585569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 663/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:05:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 10:05:26.608111 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4f48e-1f41-4ed9-82a4-a8374fbd1fb2 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:26.700850 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:26.708194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4f48e-1f41-4ed9-82a4-a8374fbd1fb2 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:26.740626 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eab24-154c-412c-a795-322b8e5ac313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:26.741515 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eab24-154c-412c-a795-322b8e5ac313 None admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:26.741802 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eab24-154c-412c-a795-322b8e5ac313 None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:26.742079 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eab24-154c-412c-a795-322b8e5ac313 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:26.742725 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eab24-154c-412c-a795-322b8e5ac313 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:26.744095 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eab24-154c-412c-a795-322b8e5ac313 None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application [None req-ef6eab24-154c-412c-a795-322b8e5ac313 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 10:05:26.755754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 10:05:26.756974 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application with Lock( Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self._enter() Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application return self.creator() Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application created_value = creator( Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: ERROR keystone.server.flask.application Jul 05 10:05:26.758162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 641/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Tue Jul 5 10:05:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 10:05:26.762959 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb61b-e0bb-43fe-9fd1-6ddf96739171 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:26.837120 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:26.859477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb61b-e0bb-43fe-9fd1-6ddf96739171 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:26.892947 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908db926-d3ff-4f60-a1c2-ca4cf6204d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:26.893619 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908db926-d3ff-4f60-a1c2-ca4cf6204d30 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:26.893909 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908db926-d3ff-4f60-a1c2-ca4cf6204d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:26.894193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908db926-d3ff-4f60-a1c2-ca4cf6204d30 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:26.894895 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908db926-d3ff-4f60-a1c2-ca4cf6204d30 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:05:26.895208 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908db926-d3ff-4f60-a1c2-ca4cf6204d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:26.896608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908db926-d3ff-4f60-a1c2-ca4cf6204d30 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:26.901674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 664/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Tue Jul 5 10:05:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:05:26.907543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eab24-154c-412c-a795-322b8e5ac313 None admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:05:27.003436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eab24-154c-412c-a795-322b8e5ac313 None admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:05:27.036553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde2751-df04-436a-a910-32db49d68eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:05:27.037244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde2751-df04-436a-a910-32db49d68eaa None admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:05:27.037605 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde2751-df04-436a-a910-32db49d68eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:05:27.037967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde2751-df04-436a-a910-32db49d68eaa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:05:27.038864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde2751-df04-436a-a910-32db49d68eaa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:05:27.040587 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde2751-df04-436a-a910-32db49d68eaa None admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:05:27.062727 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 642/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Tue Jul 5 10:05:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:05:36.898649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=30 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:37.057626 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:29.779466 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea5755-b264-4941-84c0-978335352223 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:29.779920 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea5755-b264-4941-84c0-978335352223 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:29.779999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea5755-b264-4941-84c0-978335352223 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:29.786994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b06592-0e4f-4605-b6e1-a99303a03bba None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:29.787398 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b06592-0e4f-4605-b6e1-a99303a03bba None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:29.787548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b06592-0e4f-4605-b6e1-a99303a03bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:29.790327 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 665/1307] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:06:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:29.897867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-82b06592-0e4f-4605-b6e1-a99303a03bba None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:29.899273 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-82b06592-0e4f-4605-b6e1-a99303a03bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:30.047361 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 643/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:06:30.095193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df40249-1b61-4d4c-bebb-ba413eb15d90 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:30.095624 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df40249-1b61-4d4c-bebb-ba413eb15d90 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:30.096009 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df40249-1b61-4d4c-bebb-ba413eb15d90 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:30.097788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 666/1309] 10.222.0.13 () {54 vars in 964 bytes} [Tue Jul 5 10:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:30.113271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cbbee-66c8-4d58-9c03-2b2085abcb6e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:30.113703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cbbee-66c8-4d58-9c03-2b2085abcb6e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:30.113992 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cbbee-66c8-4d58-9c03-2b2085abcb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:30.216226 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5c2cbbee-66c8-4d58-9c03-2b2085abcb6e None None] MFA Rules not processed for user `0712574ba8f54b4283c50a74019d315b`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:30.217625 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5c2cbbee-66c8-4d58-9c03-2b2085abcb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:30.243673 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:30.318981 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 644/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Tue Jul 5 10:06:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:06:30.327827 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df40249-1b61-4d4c-bebb-ba413eb15d90 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:06:30.329988 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3df40249-1b61-4d4c-bebb-ba413eb15d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:30.457345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df40249-1b61-4d4c-bebb-ba413eb15d90 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:06:30.533368 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b91cf-d25a-41c8-b4ac-bb65922f5402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:06:30.534097 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b91cf-d25a-41c8-b4ac-bb65922f5402 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:30.534391 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b91cf-d25a-41c8-b4ac-bb65922f5402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:30.534673 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b91cf-d25a-41c8-b4ac-bb65922f5402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:30.536322 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-589b91cf-d25a-41c8-b4ac-bb65922f5402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:30.591073 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:30.652278 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b91cf-d25a-41c8-b4ac-bb65922f5402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:06:30.653910 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b91cf-d25a-41c8-b4ac-bb65922f5402 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:06:30.674161 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 667/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:06:33.056002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4a85-f4bf-45e3-a2ff-d0b9ab0c9fa9 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:33.056533 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4a85-f4bf-45e3-a2ff-d0b9ab0c9fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:33.056533 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed4a85-f4bf-45e3-a2ff-d0b9ab0c9fa9 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:33.057963 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 645/1312] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:33.063803 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af6a61-2aef-4d71-8d28-f32b7d32de9e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:33.064206 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af6a61-2aef-4d71-8d28-f32b7d32de9e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:33.064371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af6a61-2aef-4d71-8d28-f32b7d32de9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:33.142636 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d6af6a61-2aef-4d71-8d28-f32b7d32de9e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:33.143857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d6af6a61-2aef-4d71-8d28-f32b7d32de9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:33.240272 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 668/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:06:33.278407 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed4a85-f4bf-45e3-a2ff-d0b9ab0c9fa9 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:06:33.279969 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5bed4a85-f4bf-45e3-a2ff-d0b9ab0c9fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:33.391181 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed4a85-f4bf-45e3-a2ff-d0b9ab0c9fa9 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:06:33.463012 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:33.465414 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4a007-01a6-42df-ad4c-3cec54dbbc85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:06:33.466204 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4a007-01a6-42df-ad4c-3cec54dbbc85 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:33.466687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4a007-01a6-42df-ad4c-3cec54dbbc85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:33.467142 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4a007-01a6-42df-ad4c-3cec54dbbc85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:33.469146 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-52b4a007-01a6-42df-ad4c-3cec54dbbc85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:33.577407 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4a007-01a6-42df-ad4c-3cec54dbbc85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:06:33.579351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4a007-01a6-42df-ad4c-3cec54dbbc85 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:06:33.597281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 646/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:06:35.913970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ee8c0-5cd9-445a-bc49-cd14a84e7f1c None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:35.914494 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ee8c0-5cd9-445a-bc49-cd14a84e7f1c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:35.914494 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ee8c0-5cd9-445a-bc49-cd14a84e7f1c None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:35.915839 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 669/1315] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:35.920849 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45510f77-4800-478b-9f3e-b7f94976ab1c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:35.921253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45510f77-4800-478b-9f3e-b7f94976ab1c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:35.921446 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45510f77-4800-478b-9f3e-b7f94976ab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:35.984020 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-45510f77-4800-478b-9f3e-b7f94976ab1c None None] MFA Rules not processed for user `fdbc028fc50242ca95b20286bf2d6e57`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:35.985747 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-45510f77-4800-478b-9f3e-b7f94976ab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:36.035892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:36.080236 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 647/1316] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:06:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:06:36.119589 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ee8c0-5cd9-445a-bc49-cd14a84e7f1c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:06:36.121147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-583ee8c0-5cd9-445a-bc49-cd14a84e7f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:36.130737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:36.223990 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ee8c0-5cd9-445a-bc49-cd14a84e7f1c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:06:36.294688 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c5168-14d5-431b-8557-4a47614914f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:06:36.295337 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c5168-14d5-431b-8557-4a47614914f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:36.295622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c5168-14d5-431b-8557-4a47614914f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:36.295901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c5168-14d5-431b-8557-4a47614914f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:36.298210 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-728c5168-14d5-431b-8557-4a47614914f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:36.357987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:36.404194 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c5168-14d5-431b-8557-4a47614914f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:06:36.405649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c5168-14d5-431b-8557-4a47614914f8 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:06:36.424625 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 670/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:06:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:06:38.971785 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629dbaf-c949-4de2-80d8-816fbe428b52 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:38.972339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629dbaf-c949-4de2-80d8-816fbe428b52 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:38.972339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629dbaf-c949-4de2-80d8-816fbe428b52 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:38.973754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 648/1318] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:38.978745 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee200e9-517e-4e20-a361-89d74a52beb7 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:38.979114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee200e9-517e-4e20-a361-89d74a52beb7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:38.979304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee200e9-517e-4e20-a361-89d74a52beb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:39.043142 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2ee200e9-517e-4e20-a361-89d74a52beb7 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:39.044345 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2ee200e9-517e-4e20-a361-89d74a52beb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:39.138161 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 671/1319] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:06:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:06:39.176682 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629dbaf-c949-4de2-80d8-816fbe428b52 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:06:39.178139 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-0629dbaf-c949-4de2-80d8-816fbe428b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:39.275293 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629dbaf-c949-4de2-80d8-816fbe428b52 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:06:39.347792 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592e915-80d2-406d-9ee4-663b9d0dcb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:06:39.348433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e915-80d2-406d-9ee4-663b9d0dcb60 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:39.348715 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e915-80d2-406d-9ee4-663b9d0dcb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:39.349018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e915-80d2-406d-9ee4-663b9d0dcb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:39.350631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2592e915-80d2-406d-9ee4-663b9d0dcb60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:39.357824 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:39.457316 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592e915-80d2-406d-9ee4-663b9d0dcb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:06:39.458743 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592e915-80d2-406d-9ee4-663b9d0dcb60 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:06:39.476599 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 649/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:06:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:06:42.121181 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f358cd-15c5-4326-8d36-5bb51fbdd4fb None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:42.121744 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f358cd-15c5-4326-8d36-5bb51fbdd4fb None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:42.121744 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f358cd-15c5-4326-8d36-5bb51fbdd4fb None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:42.123122 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 672/1321] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:42.128748 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e239125-3bd0-4a07-952b-af96e9eb122b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:42.129190 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e239125-3bd0-4a07-952b-af96e9eb122b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:42.129353 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e239125-3bd0-4a07-952b-af96e9eb122b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:42.194244 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-3e239125-3bd0-4a07-952b-af96e9eb122b None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:42.195451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-3e239125-3bd0-4a07-952b-af96e9eb122b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:42.251793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:42.295426 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 650/1322] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:06:42.332549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f358cd-15c5-4326-8d36-5bb51fbdd4fb None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:06:42.334220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-24f358cd-15c5-4326-8d36-5bb51fbdd4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:42.354525 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:42.443977 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f358cd-15c5-4326-8d36-5bb51fbdd4fb None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:06:42.518989 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77857962-4cf3-4daa-96ac-43465e9ef92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:06:42.519638 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77857962-4cf3-4daa-96ac-43465e9ef92b service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:42.519925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77857962-4cf3-4daa-96ac-43465e9ef92b service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:42.520200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77857962-4cf3-4daa-96ac-43465e9ef92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:42.521858 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-77857962-4cf3-4daa-96ac-43465e9ef92b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:42.591666 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:42.629524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77857962-4cf3-4daa-96ac-43465e9ef92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:06:42.630967 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77857962-4cf3-4daa-96ac-43465e9ef92b service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:06:42.649960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 673/1323] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:06:44.738041 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfdf2a-d60e-4cd1-bc5b-1f7fb2d15c0e None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:44.738556 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfdf2a-d60e-4cd1-bc5b-1f7fb2d15c0e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:44.738556 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfdf2a-d60e-4cd1-bc5b-1f7fb2d15c0e None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:44.739917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 651/1324] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:44.745284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e114-5626-4f24-8c97-770a1296bdca None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:44.745672 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e114-5626-4f24-8c97-770a1296bdca None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:44.745942 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e114-5626-4f24-8c97-770a1296bdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:44.812566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ba59e114-5626-4f24-8c97-770a1296bdca None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:44.814419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ba59e114-5626-4f24-8c97-770a1296bdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:44.908633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 674/1325] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:06:44.945123 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfdf2a-d60e-4cd1-bc5b-1f7fb2d15c0e None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:06:44.946804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-65cfdf2a-d60e-4cd1-bc5b-1f7fb2d15c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:45.057504 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfdf2a-d60e-4cd1-bc5b-1f7fb2d15c0e None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:06:45.130701 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ee3ec-2185-4d57-acc8-4d1bfc272890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:06:45.131351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ee3ec-2185-4d57-acc8-4d1bfc272890 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:45.131635 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ee3ec-2185-4d57-acc8-4d1bfc272890 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:45.131913 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ee3ec-2185-4d57-acc8-4d1bfc272890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:45.133567 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-953ee3ec-2185-4d57-acc8-4d1bfc272890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:45.150826 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:45.246206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ee3ec-2185-4d57-acc8-4d1bfc272890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:06:45.247656 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ee3ec-2185-4d57-acc8-4d1bfc272890 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:06:45.266759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 652/1326] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:06:47.374959 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641fcaf-5843-4de8-a1ea-36165617d02c None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:47.375477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641fcaf-5843-4de8-a1ea-36165617d02c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:47.375570 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641fcaf-5843-4de8-a1ea-36165617d02c None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:47.376915 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 675/1327] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:47.382202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baee13-6ba5-4b8b-8390-850ea0fd6d07 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:47.382638 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baee13-6ba5-4b8b-8390-850ea0fd6d07 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:47.382735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baee13-6ba5-4b8b-8390-850ea0fd6d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:47.448356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-85baee13-6ba5-4b8b-8390-850ea0fd6d07 None None] MFA Rules not processed for user `fdbc028fc50242ca95b20286bf2d6e57`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:47.449529 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-85baee13-6ba5-4b8b-8390-850ea0fd6d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:47.540756 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:47.574450 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 653/1328] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:06:47.612183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641fcaf-5843-4de8-a1ea-36165617d02c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:06:47.613753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9641fcaf-5843-4de8-a1ea-36165617d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:47.644209 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:47.718778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641fcaf-5843-4de8-a1ea-36165617d02c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:06:47.792797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546459ac-08fb-498a-9974-b7790065e0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:06:47.793482 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546459ac-08fb-498a-9974-b7790065e0ea service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:47.793769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546459ac-08fb-498a-9974-b7790065e0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:47.794053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546459ac-08fb-498a-9974-b7790065e0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:47.795734 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-546459ac-08fb-498a-9974-b7790065e0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:47.872351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:47.905622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546459ac-08fb-498a-9974-b7790065e0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:06:47.907664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546459ac-08fb-498a-9974-b7790065e0ea service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:06:47.939531 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 676/1329] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:06:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:06:50.213702 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d5bf-279b-4064-959b-5ab4a3e8f2e0 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:50.214337 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d5bf-279b-4064-959b-5ab4a3e8f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:50.214337 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d5bf-279b-4064-959b-5ab4a3e8f2e0 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:50.215644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 654/1330] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:50.220932 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229789a-4cf3-46b4-a449-ce462eaf1e63 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:50.221365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229789a-4cf3-46b4-a449-ce462eaf1e63 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:50.221504 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229789a-4cf3-46b4-a449-ce462eaf1e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:50.284412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1229789a-4cf3-46b4-a449-ce462eaf1e63 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:50.285679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1229789a-4cf3-46b4-a449-ce462eaf1e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:50.379694 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 677/1331] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:06:50.427903 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999507-24c3-40c5-85c5-d121fac05143 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:50.428194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999507-24c3-40c5-85c5-d121fac05143 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:50.428471 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999507-24c3-40c5-85c5-d121fac05143 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:50.429876 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 655/1332] 10.222.0.13 () {54 vars in 964 bytes} [Tue Jul 5 10:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:50.435525 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842252-654e-47ca-a57a-8dcb264faf28 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:50.435815 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842252-654e-47ca-a57a-8dcb264faf28 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:50.436093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842252-654e-47ca-a57a-8dcb264faf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:50.479034 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:50.514082 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-13842252-654e-47ca-a57a-8dcb264faf28 None None] MFA Rules not processed for user `0712574ba8f54b4283c50a74019d315b`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:50.515303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-13842252-654e-47ca-a57a-8dcb264faf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:50.589448 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 678/1333] 10.222.0.13 () {58 vars in 1061 bytes} [Tue Jul 5 10:06:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:06:50.599131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8999507-24c3-40c5-85c5-d121fac05143 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:06:50.600744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a8999507-24c3-40c5-85c5-d121fac05143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:50.700956 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8999507-24c3-40c5-85c5-d121fac05143 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:06:50.772395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e81284-a7d5-42c8-9bc1-c3ce7800d55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:06:50.773072 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e81284-a7d5-42c8-9bc1-c3ce7800d55f service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:50.773360 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e81284-a7d5-42c8-9bc1-c3ce7800d55f service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:50.773636 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e81284-a7d5-42c8-9bc1-c3ce7800d55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:50.775269 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f2e81284-a7d5-42c8-9bc1-c3ce7800d55f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:50.803464 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:50.883268 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e81284-a7d5-42c8-9bc1-c3ce7800d55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:06:50.884711 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e81284-a7d5-42c8-9bc1-c3ce7800d55f service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:06:50.902155 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 656/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:06:53.189748 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643c015-40f1-4dcf-a11b-d904be002be0 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:53.190305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643c015-40f1-4dcf-a11b-d904be002be0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:53.190305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643c015-40f1-4dcf-a11b-d904be002be0 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:53.191682 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 679/1335] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:53.196840 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be1372-7fe2-4fef-9234-2403a68bf6c2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:53.197286 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be1372-7fe2-4fef-9234-2403a68bf6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:53.197435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be1372-7fe2-4fef-9234-2403a68bf6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:53.261228 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-85be1372-7fe2-4fef-9234-2403a68bf6c2 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:53.262390 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-85be1372-7fe2-4fef-9234-2403a68bf6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:53.333849 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:53.356027 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 657/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:06:53.395906 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643c015-40f1-4dcf-a11b-d904be002be0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:06:53.397459 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a643c015-40f1-4dcf-a11b-d904be002be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:53.498160 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643c015-40f1-4dcf-a11b-d904be002be0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:06:53.525865 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:53.569961 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b4486-7cb1-4b22-b9a1-9fa43d81ba1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:06:53.570595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b4486-7cb1-4b22-b9a1-9fa43d81ba1e service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:53.570878 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b4486-7cb1-4b22-b9a1-9fa43d81ba1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:53.571152 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b4486-7cb1-4b22-b9a1-9fa43d81ba1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:53.572756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ba7b4486-7cb1-4b22-b9a1-9fa43d81ba1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:53.678318 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b4486-7cb1-4b22-b9a1-9fa43d81ba1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:06:53.679742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b4486-7cb1-4b22-b9a1-9fa43d81ba1e service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:06:53.697265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 680/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:06:56.320744 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8df0-2d2c-46bb-bd6a-499a25eba351 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:56.321198 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8df0-2d2c-46bb-bd6a-499a25eba351 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:56.321337 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8df0-2d2c-46bb-bd6a-499a25eba351 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:56.322718 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 658/1338] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:06:56.327826 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbe391-9359-431b-a356-54059aa3ed6d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:56.328313 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbe391-9359-431b-a356-54059aa3ed6d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:56.329010 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbe391-9359-431b-a356-54059aa3ed6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:56.392228 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a6bbe391-9359-431b-a356-54059aa3ed6d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:06:56.393465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a6bbe391-9359-431b-a356-54059aa3ed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:56.401632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:56.490222 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 681/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:06:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:06:56.526582 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d8df0-2d2c-46bb-bd6a-499a25eba351 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:06:56.528090 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-053d8df0-2d2c-46bb-bd6a-499a25eba351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:56.628266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d8df0-2d2c-46bb-bd6a-499a25eba351 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:06:56.698159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e814e17-1a6e-469a-bac1-d905cdbb2daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:06:56.698789 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814e17-1a6e-469a-bac1-d905cdbb2daf service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:06:56.699069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814e17-1a6e-469a-bac1-d905cdbb2daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:06:56.699344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814e17-1a6e-469a-bac1-d905cdbb2daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:06:56.700954 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7e814e17-1a6e-469a-bac1-d905cdbb2daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:06:56.735199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:56.807738 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e814e17-1a6e-469a-bac1-d905cdbb2daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:06:56.809197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e814e17-1a6e-469a-bac1-d905cdbb2daf service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:06:56.826982 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 659/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:06:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:00.944453 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c865c41-3656-42f2-a0f0-c538ef3a4302 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:00.944979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c865c41-3656-42f2-a0f0-c538ef3a4302 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:00.944979 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c865c41-3656-42f2-a0f0-c538ef3a4302 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:00.946415 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 682/1341] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:00.951735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976e1a-9e31-4cf1-babe-25d204553fd8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:00.952156 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976e1a-9e31-4cf1-babe-25d204553fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:00.952298 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976e1a-9e31-4cf1-babe-25d204553fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:01.021420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-fe976e1a-9e31-4cf1-babe-25d204553fd8 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:01.022617 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-fe976e1a-9e31-4cf1-babe-25d204553fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:01.114393 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:07:01.128557 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 660/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:07:01.167205 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c865c41-3656-42f2-a0f0-c538ef3a4302 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:01.169408 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3c865c41-3656-42f2-a0f0-c538ef3a4302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:01.263746 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c865c41-3656-42f2-a0f0-c538ef3a4302 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:01.267551 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e082-064e-4d50-8153-9396219d7982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:01.268200 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e082-064e-4d50-8153-9396219d7982 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:01.268485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e082-064e-4d50-8153-9396219d7982 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:01.268765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e082-064e-4d50-8153-9396219d7982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:01.277720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596e082-064e-4d50-8153-9396219d7982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:01.279142 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596e082-064e-4d50-8153-9396219d7982 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:01.288719 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 683/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:03.923044 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da4c81-0266-49a7-9d9a-53f56492dd3a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:03.923573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da4c81-0266-49a7-9d9a-53f56492dd3a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:03.923573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da4c81-0266-49a7-9d9a-53f56492dd3a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:03.925197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 661/1344] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:03.930626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed1c8-6b77-4ca1-9bf9-1c65d2539e26 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:03.931027 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed1c8-6b77-4ca1-9bf9-1c65d2539e26 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:03.931349 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed1c8-6b77-4ca1-9bf9-1c65d2539e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:03.959665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-69aed1c8-6b77-4ca1-9bf9-1c65d2539e26 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:03.960858 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-69aed1c8-6b77-4ca1-9bf9-1c65d2539e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:03.988132 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:07:04.044620 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 684/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:07:04.083687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da4c81-0266-49a7-9d9a-53f56492dd3a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:04.094688 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da4c81-0266-49a7-9d9a-53f56492dd3a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:04.098197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ed4b7-2278-4cca-8654-122ebc66895f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:04.098847 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed4b7-2278-4cca-8654-122ebc66895f service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:04.099126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed4b7-2278-4cca-8654-122ebc66895f service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:04.099400 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed4b7-2278-4cca-8654-122ebc66895f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:04.109159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ed4b7-2278-4cca-8654-122ebc66895f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:04.110651 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ed4b7-2278-4cca-8654-122ebc66895f service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:04.121117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 662/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:08.096732 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39cb99-b38c-4623-b569-885529d1c3a4 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:08.097269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39cb99-b38c-4623-b569-885529d1c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:08.097269 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39cb99-b38c-4623-b569-885529d1c3a4 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:08.098627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 685/1347] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:08.103835 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbb54f-cdd0-4c3f-9267-cfda4501b621 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:08.104238 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbb54f-cdd0-4c3f-9267-cfda4501b621 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:08.104524 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbb54f-cdd0-4c3f-9267-cfda4501b621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:08.122136 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-8ddbb54f-cdd0-4c3f-9267-cfda4501b621 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:08.123334 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8ddbb54f-cdd0-4c3f-9267-cfda4501b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:08.132452 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 663/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:08.169604 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39cb99-b38c-4623-b569-885529d1c3a4 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:08.184329 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39cb99-b38c-4623-b569-885529d1c3a4 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:08.188813 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd2768-a8d4-496d-ad4a-9cff6339f41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:08.189601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd2768-a8d4-496d-ad4a-9cff6339f41b service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:08.189882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd2768-a8d4-496d-ad4a-9cff6339f41b service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:08.190163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd2768-a8d4-496d-ad4a-9cff6339f41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:08.200035 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd2768-a8d4-496d-ad4a-9cff6339f41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:08.201530 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd2768-a8d4-496d-ad4a-9cff6339f41b service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:08.211663 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 686/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:13.128636 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769766f-3bbe-4195-a2cc-10651a6056e0 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:13.129123 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769766f-3bbe-4195-a2cc-10651a6056e0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:13.129451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769766f-3bbe-4195-a2cc-10651a6056e0 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:13.131364 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 664/1350] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 10:07:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:13.137470 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff00a7-ea30-42d7-82f7-d73e6dbcc936 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:13.137894 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff00a7-ea30-42d7-82f7-d73e6dbcc936 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:13.138243 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff00a7-ea30-42d7-82f7-d73e6dbcc936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:13.270351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b8ff00a7-ea30-42d7-82f7-d73e6dbcc936 None None] MFA Rules not processed for user `2df8f75ab3ab4468afdd39e7b8e4793f`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:13.272016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b8ff00a7-ea30-42d7-82f7-d73e6dbcc936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:13.368319 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 687/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 10:07:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:17.729884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270074d6-5138-48ab-a3fa-fb5a5b139fdc None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:17.730774 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270074d6-5138-48ab-a3fa-fb5a5b139fdc None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:17.731043 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270074d6-5138-48ab-a3fa-fb5a5b139fdc None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:17.732600 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 665/1352] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 10:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:17.738174 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe960f-cae7-47c0-9c57-84ac8b538aca None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:17.738728 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe960f-cae7-47c0-9c57-84ac8b538aca None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:17.738728 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe960f-cae7-47c0-9c57-84ac8b538aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:17.758399 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-dffe960f-cae7-47c0-9c57-84ac8b538aca None None] MFA Rules not processed for user `2df8f75ab3ab4468afdd39e7b8e4793f`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:17.759656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-dffe960f-cae7-47c0-9c57-84ac8b538aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:17.769980 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 688/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 10:07:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:18.117112 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=13 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:07:19.003994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9b37-f865-4627-9616-798dffb441b3 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:19.004616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9b37-f865-4627-9616-798dffb441b3 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:19.004616 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9b37-f865-4627-9616-798dffb441b3 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:19.005928 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 666/1354] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 10:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:19.010872 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecb544-13f4-4f5a-9ef4-3012ef6bdbe0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:19.011324 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecb544-13f4-4f5a-9ef4-3012ef6bdbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:19.011571 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecb544-13f4-4f5a-9ef4-3012ef6bdbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:19.029249 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c1ecb544-13f4-4f5a-9ef4-3012ef6bdbe0 None None] MFA Rules not processed for user `2df8f75ab3ab4468afdd39e7b8e4793f`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:19.030526 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c1ecb544-13f4-4f5a-9ef4-3012ef6bdbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:19.040733 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 689/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 10:07:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:22.634885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef1c0-6793-4cf7-a367-7840a62f3d74 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:22.636358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef1c0-6793-4cf7-a367-7840a62f3d74 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:22.636656 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef1c0-6793-4cf7-a367-7840a62f3d74 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:22.638260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 667/1356] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:22.643661 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c22c2-8fae-4c5f-8364-18098545b8cf None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:22.644458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c22c2-8fae-4c5f-8364-18098545b8cf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:22.644744 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c22c2-8fae-4c5f-8364-18098545b8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:22.670680 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e86c22c2-8fae-4c5f-8364-18098545b8cf None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:22.672711 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e86c22c2-8fae-4c5f-8364-18098545b8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:22.681613 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 690/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:22.736865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce29e9-83d9-4d85-b7d0-d77c246cab21 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:22.737442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce29e9-83d9-4d85-b7d0-d77c246cab21 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:22.738060 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce29e9-83d9-4d85-b7d0-d77c246cab21 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:22.739924 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 668/1358] 10.222.0.13 () {54 vars in 961 bytes} [Tue Jul 5 10:07:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:22.748236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56701-a11d-46d4-b759-08e72c0c3baa None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:22.749140 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56701-a11d-46d4-b759-08e72c0c3baa None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:22.750458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56701-a11d-46d4-b759-08e72c0c3baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:22.801611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:07:22.811242 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-93e56701-a11d-46d4-b759-08e72c0c3baa None None] MFA Rules not processed for user `1ff81129f179478d901b590a5be64f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:22.813293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-93e56701-a11d-46d4-b759-08e72c0c3baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:22.905753 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 691/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Jul 5 10:07:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:07:22.913594 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce29e9-83d9-4d85-b7d0-d77c246cab21 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:22.928662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce29e9-83d9-4d85-b7d0-d77c246cab21 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:22.934278 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf47634-03ed-43ce-9cf3-b6231fd28244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:22.934907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf47634-03ed-43ce-9cf3-b6231fd28244 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:22.935190 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf47634-03ed-43ce-9cf3-b6231fd28244 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:22.935462 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf47634-03ed-43ce-9cf3-b6231fd28244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:22.945055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf47634-03ed-43ce-9cf3-b6231fd28244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:22.946639 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf47634-03ed-43ce-9cf3-b6231fd28244 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:22.957097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 669/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 10:07:25.178878 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd8a4b-9b0c-48bf-b501-12a5af0c7b11 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:25.179430 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd8a4b-9b0c-48bf-b501-12a5af0c7b11 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:25.179430 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd8a4b-9b0c-48bf-b501-12a5af0c7b11 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:25.180998 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 692/1361] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:25.185984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a63c8-b2c6-4041-a6a4-8c1d6950a52d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:25.186440 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a63c8-b2c6-4041-a6a4-8c1d6950a52d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:25.186550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a63c8-b2c6-4041-a6a4-8c1d6950a52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:25.205233 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6d3a63c8-b2c6-4041-a6a4-8c1d6950a52d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:25.206456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6d3a63c8-b2c6-4041-a6a4-8c1d6950a52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:25.214352 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 670/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:25.258046 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd8a4b-9b0c-48bf-b501-12a5af0c7b11 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:25.274326 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd8a4b-9b0c-48bf-b501-12a5af0c7b11 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:25.286781 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58547b74-f977-432b-a425-220a4816d48b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:25.286781 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547b74-f977-432b-a425-220a4816d48b service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:25.286781 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547b74-f977-432b-a425-220a4816d48b service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:25.286781 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547b74-f977-432b-a425-220a4816d48b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:25.303221 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58547b74-f977-432b-a425-220a4816d48b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:25.305153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58547b74-f977-432b-a425-220a4816d48b service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:25.329985 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 693/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:27.713162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365cae2-c2b0-4b56-9400-69b4fb029e0c None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:27.714091 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365cae2-c2b0-4b56-9400-69b4fb029e0c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:27.714584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365cae2-c2b0-4b56-9400-69b4fb029e0c None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:27.716451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 671/1364] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:27.722037 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022ef22-ef80-48ca-ba72-e2fb85f52c12 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:27.722883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022ef22-ef80-48ca-ba72-e2fb85f52c12 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:27.723383 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022ef22-ef80-48ca-ba72-e2fb85f52c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:27.741596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-7022ef22-ef80-48ca-ba72-e2fb85f52c12 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:27.742768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7022ef22-ef80-48ca-ba72-e2fb85f52c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:27.751061 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 694/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:27.795068 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b012f7-ea4c-4fb2-8655-4cee5e279655 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:27.795355 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b012f7-ea4c-4fb2-8655-4cee5e279655 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:27.795634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b012f7-ea4c-4fb2-8655-4cee5e279655 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:27.797532 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 672/1366] 10.222.0.13 () {54 vars in 961 bytes} [Tue Jul 5 10:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:27.803034 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720888e9-ebae-476e-9ed0-f413bb698d73 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:27.803322 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720888e9-ebae-476e-9ed0-f413bb698d73 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:27.803602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720888e9-ebae-476e-9ed0-f413bb698d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:27.821847 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-720888e9-ebae-476e-9ed0-f413bb698d73 None None] MFA Rules not processed for user `1ff81129f179478d901b590a5be64f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:27.823047 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-720888e9-ebae-476e-9ed0-f413bb698d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:27.832097 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 695/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Jul 5 10:07:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:27.839875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b012f7-ea4c-4fb2-8655-4cee5e279655 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:27.854721 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b012f7-ea4c-4fb2-8655-4cee5e279655 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:27.860591 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2d8ec-ad2b-4500-a3cd-2e51a30f2a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:27.861238 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2d8ec-ad2b-4500-a3cd-2e51a30f2a1e service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:27.861520 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2d8ec-ad2b-4500-a3cd-2e51a30f2a1e service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:27.861804 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2d8ec-ad2b-4500-a3cd-2e51a30f2a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:27.869720 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2d8ec-ad2b-4500-a3cd-2e51a30f2a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:27.871285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2d8ec-ad2b-4500-a3cd-2e51a30f2a1e service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:27.880817 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 673/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 10:07:29.986107 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c3412-0502-4b78-95cf-48327472bdaa None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:29.986605 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c3412-0502-4b78-95cf-48327472bdaa None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:29.986605 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c3412-0502-4b78-95cf-48327472bdaa None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:29.987976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 696/1369] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:29.993689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acfe4-ec24-4860-a659-0f2ddfc02b41 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:29.994092 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acfe4-ec24-4860-a659-0f2ddfc02b41 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:29.994252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acfe4-ec24-4860-a659-0f2ddfc02b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:30.013773 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f50acfe4-ec24-4860-a659-0f2ddfc02b41 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:30.015049 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f50acfe4-ec24-4860-a659-0f2ddfc02b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:30.023760 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 674/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:30.073115 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c3412-0502-4b78-95cf-48327472bdaa None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:30.087847 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c3412-0502-4b78-95cf-48327472bdaa None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:30.093434 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172b0c3-184e-4070-9ccd-7fb6872a762b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:30.094680 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172b0c3-184e-4070-9ccd-7fb6872a762b service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:30.095058 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172b0c3-184e-4070-9ccd-7fb6872a762b service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:30.095407 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172b0c3-184e-4070-9ccd-7fb6872a762b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:30.104351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172b0c3-184e-4070-9ccd-7fb6872a762b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:30.106073 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172b0c3-184e-4070-9ccd-7fb6872a762b service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:30.116831 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 697/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:30.690420 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74961697-c570-449f-be07-34be9e35a105 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:30.690926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74961697-c570-449f-be07-34be9e35a105 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:30.691375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74961697-c570-449f-be07-34be9e35a105 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:30.692936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 675/1372] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:30.698178 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4dfd-ffdf-45a2-aa87-9fd5f51f9590 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:30.698648 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4dfd-ffdf-45a2-aa87-9fd5f51f9590 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:30.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4dfd-ffdf-45a2-aa87-9fd5f51f9590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:30.718125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-bcbf4dfd-ffdf-45a2-aa87-9fd5f51f9590 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:30.719686 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bcbf4dfd-ffdf-45a2-aa87-9fd5f51f9590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:30.727589 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 698/1373] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:31.071994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875d37-ad3e-4408-a3d9-fe2e4eb3af51 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:31.071994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875d37-ad3e-4408-a3d9-fe2e4eb3af51 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:31.071994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875d37-ad3e-4408-a3d9-fe2e4eb3af51 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:31.073863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 676/1374] 10.222.0.13 () {54 vars in 963 bytes} [Tue Jul 5 10:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:31.077655 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402e78e-6bb0-4fac-b035-0cd2afa49f59 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:31.077655 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402e78e-6bb0-4fac-b035-0cd2afa49f59 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:31.078899 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402e78e-6bb0-4fac-b035-0cd2afa49f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:31.134346 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a402e78e-6bb0-4fac-b035-0cd2afa49f59 None None] MFA Rules not processed for user `878b64982654402297d65a8ca4ad6ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:31.135552 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a402e78e-6bb0-4fac-b035-0cd2afa49f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:31.198263 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 699/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Tue Jul 5 10:07:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:31.205631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af875d37-ad3e-4408-a3d9-fe2e4eb3af51 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:31.216151 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af875d37-ad3e-4408-a3d9-fe2e4eb3af51 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:31.219675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f98668-f484-4081-89e3-58c0db9ca00e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878b64982654402297d65a8ca4ad6ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:31.220309 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f98668-f484-4081-89e3-58c0db9ca00e service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:31.220588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f98668-f484-4081-89e3-58c0db9ca00e service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:31.221108 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f98668-f484-4081-89e3-58c0db9ca00e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:31.230467 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f98668-f484-4081-89e3-58c0db9ca00e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:31.232096 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f98668-f484-4081-89e3-58c0db9ca00e service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:31.242437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 677/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:32.186768 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b4735-ec56-416a-9f2f-f0843986a13b None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:32.187371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b4735-ec56-416a-9f2f-f0843986a13b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:32.187371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b4735-ec56-416a-9f2f-f0843986a13b None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:32.188769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 700/1377] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:32.194077 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e575-0bed-47c4-bc5e-7d5f758a3194 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:32.194482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e575-0bed-47c4-bc5e-7d5f758a3194 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:32.194771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e575-0bed-47c4-bc5e-7d5f758a3194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:32.212771 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-99e5e575-0bed-47c4-bc5e-7d5f758a3194 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:32.214084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-99e5e575-0bed-47c4-bc5e-7d5f758a3194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:32.222625 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 678/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:32.265114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b4735-ec56-416a-9f2f-f0843986a13b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:32.279771 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b4735-ec56-416a-9f2f-f0843986a13b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:32.285938 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbb68b-37d4-4d08-b623-d2603c4701b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:32.286714 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbb68b-37d4-4d08-b623-d2603c4701b8 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:32.287069 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbb68b-37d4-4d08-b623-d2603c4701b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:32.287423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbb68b-37d4-4d08-b623-d2603c4701b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:32.298275 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbb68b-37d4-4d08-b623-d2603c4701b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:32.300012 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbb68b-37d4-4d08-b623-d2603c4701b8 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:32.304274 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:07:32.311145 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 701/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:34.381680 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8212-3558-44b3-b65d-2c1f659693bb None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:34.382182 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8212-3558-44b3-b65d-2c1f659693bb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:34.382277 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8212-3558-44b3-b65d-2c1f659693bb None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:34.383606 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 679/1380] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:34.388602 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067c2aa-f794-433d-9d33-21ead9263ac9 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:34.389043 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067c2aa-f794-433d-9d33-21ead9263ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:34.389238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067c2aa-f794-433d-9d33-21ead9263ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:34.409623 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5067c2aa-f794-433d-9d33-21ead9263ac9 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:34.410835 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5067c2aa-f794-433d-9d33-21ead9263ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:34.419341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 702/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:34.466323 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a8212-3558-44b3-b65d-2c1f659693bb None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:34.481101 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a8212-3558-44b3-b65d-2c1f659693bb None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:34.486679 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632089a9-478d-4a43-a99b-397255954ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:34.487297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632089a9-478d-4a43-a99b-397255954ada service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:34.487580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632089a9-478d-4a43-a99b-397255954ada service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:34.487849 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632089a9-478d-4a43-a99b-397255954ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:34.495951 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632089a9-478d-4a43-a99b-397255954ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:34.497565 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632089a9-478d-4a43-a99b-397255954ada service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:34.508964 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 680/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:36.591170 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe610d-2090-4167-9932-e0e035d8757e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:36.592001 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe610d-2090-4167-9932-e0e035d8757e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:36.592443 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe610d-2090-4167-9932-e0e035d8757e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:36.594084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 703/1383] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:36.603817 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac49d9-6c4c-4214-90bd-e71fff8560ee None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:36.604295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac49d9-6c4c-4214-90bd-e71fff8560ee None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:36.604380 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac49d9-6c4c-4214-90bd-e71fff8560ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:36.622891 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-65ac49d9-6c4c-4214-90bd-e71fff8560ee None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:36.624266 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-65ac49d9-6c4c-4214-90bd-e71fff8560ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:36.633029 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 681/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:36.674846 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe610d-2090-4167-9932-e0e035d8757e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:36.691127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe610d-2090-4167-9932-e0e035d8757e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:36.697235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000291f4-fa2c-46e5-8392-a9e4c78a75af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:36.698060 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000291f4-fa2c-46e5-8392-a9e4c78a75af service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:36.698431 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000291f4-fa2c-46e5-8392-a9e4c78a75af service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:36.698787 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000291f4-fa2c-46e5-8392-a9e4c78a75af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:36.708855 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000291f4-fa2c-46e5-8392-a9e4c78a75af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:36.710714 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000291f4-fa2c-46e5-8392-a9e4c78a75af service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:36.722361 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 704/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:38.766898 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c82049-a451-4132-b951-f337080100b0 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:38.767462 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c82049-a451-4132-b951-f337080100b0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:38.767462 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c82049-a451-4132-b951-f337080100b0 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:38.768826 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 682/1386] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:38.774188 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fcd90-02bc-4f4f-8b79-56f66c0ace22 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:38.774710 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fcd90-02bc-4f4f-8b79-56f66c0ace22 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:38.774710 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fcd90-02bc-4f4f-8b79-56f66c0ace22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:38.792675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b85fcd90-02bc-4f4f-8b79-56f66c0ace22 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:38.793985 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b85fcd90-02bc-4f4f-8b79-56f66c0ace22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:38.802847 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 705/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:38.846761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c82049-a451-4132-b951-f337080100b0 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:38.863018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c82049-a451-4132-b951-f337080100b0 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:38.870809 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd8f77-e714-42f6-acb4-3004945536dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:38.871626 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd8f77-e714-42f6-acb4-3004945536dc service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:38.872260 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd8f77-e714-42f6-acb4-3004945536dc service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:38.872615 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd8f77-e714-42f6-acb4-3004945536dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:38.885113 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd8f77-e714-42f6-acb4-3004945536dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:38.887389 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd8f77-e714-42f6-acb4-3004945536dc service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:38.899889 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 683/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:41.245582 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fdd5d-c3b5-4494-ba96-1694d527af29 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:41.246121 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fdd5d-c3b5-4494-ba96-1694d527af29 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:41.246309 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fdd5d-c3b5-4494-ba96-1694d527af29 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:41.248061 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 706/1389] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:41.254890 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa28b-9bd6-40ed-b614-835ed594911f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:41.255315 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa28b-9bd6-40ed-b614-835ed594911f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:41.255572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa28b-9bd6-40ed-b614-835ed594911f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:41.275318 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-392aa28b-9bd6-40ed-b614-835ed594911f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:41.276709 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-392aa28b-9bd6-40ed-b614-835ed594911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:41.285677 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 684/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:41.332111 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fdd5d-c3b5-4494-ba96-1694d527af29 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:41.347246 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fdd5d-c3b5-4494-ba96-1694d527af29 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:41.352711 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535d4f2-250f-40fb-a274-a6e1e96a6999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:41.353379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d4f2-250f-40fb-a274-a6e1e96a6999 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:41.353669 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d4f2-250f-40fb-a274-a6e1e96a6999 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:41.353949 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d4f2-250f-40fb-a274-a6e1e96a6999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:41.362914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535d4f2-250f-40fb-a274-a6e1e96a6999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:41.364785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535d4f2-250f-40fb-a274-a6e1e96a6999 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:41.375670 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 707/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:43.452310 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1618a-ce74-4a7f-8116-fdf7a6b0ea9c None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:43.453694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1618a-ce74-4a7f-8116-fdf7a6b0ea9c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:43.453694 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1618a-ce74-4a7f-8116-fdf7a6b0ea9c None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:43.454879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 685/1392] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:43.460981 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206e9c-a7fe-48e3-ad99-d2ef48fedcd5 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:43.461483 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206e9c-a7fe-48e3-ad99-d2ef48fedcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:43.461897 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206e9c-a7fe-48e3-ad99-d2ef48fedcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:43.487761 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-23206e9c-a7fe-48e3-ad99-d2ef48fedcd5 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:43.489627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-23206e9c-a7fe-48e3-ad99-d2ef48fedcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:43.501699 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 708/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:43.550588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1618a-ce74-4a7f-8116-fdf7a6b0ea9c None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:43.567840 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1618a-ce74-4a7f-8116-fdf7a6b0ea9c None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:43.574086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc0150-12d1-4fa6-bad2-3f11797b65b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:43.574728 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc0150-12d1-4fa6-bad2-3f11797b65b4 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:43.575058 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc0150-12d1-4fa6-bad2-3f11797b65b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:43.575328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc0150-12d1-4fa6-bad2-3f11797b65b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:43.584580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc0150-12d1-4fa6-bad2-3f11797b65b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:43.586211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc0150-12d1-4fa6-bad2-3f11797b65b4 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:43.597037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 686/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:45.785101 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3ff8-7fbe-46d1-92fa-2cf1f03d4c76 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:45.785657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3ff8-7fbe-46d1-92fa-2cf1f03d4c76 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:45.785657 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3ff8-7fbe-46d1-92fa-2cf1f03d4c76 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:45.787031 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 709/1395] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:45.792059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fdbc6-e336-4f8b-bb2a-96ae10b3370e None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:45.792482 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fdbc6-e336-4f8b-bb2a-96ae10b3370e None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:45.792634 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fdbc6-e336-4f8b-bb2a-96ae10b3370e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:45.810792 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-7c1fdbc6-e336-4f8b-bb2a-96ae10b3370e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:45.811987 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7c1fdbc6-e336-4f8b-bb2a-96ae10b3370e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:45.820406 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 687/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:45.864632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f3ff8-7fbe-46d1-92fa-2cf1f03d4c76 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:45.879359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f3ff8-7fbe-46d1-92fa-2cf1f03d4c76 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:45.884810 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f60fba-c25c-440c-8e20-f9b81a3f28a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:45.885494 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60fba-c25c-440c-8e20-f9b81a3f28a3 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:45.885784 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60fba-c25c-440c-8e20-f9b81a3f28a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:45.886074 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60fba-c25c-440c-8e20-f9b81a3f28a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:45.894799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f60fba-c25c-440c-8e20-f9b81a3f28a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:45.896475 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f60fba-c25c-440c-8e20-f9b81a3f28a3 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:45.906828 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 710/1397] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:46.260645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c52e4e-9d6b-4bd6-9797-b228bc63787a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:46.260965 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c52e4e-9d6b-4bd6-9797-b228bc63787a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:46.261248 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c52e4e-9d6b-4bd6-9797-b228bc63787a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:46.262693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 688/1398] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:46.268614 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6b4f2-9036-45be-8565-932170debffe None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:46.268927 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6b4f2-9036-45be-8565-932170debffe None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:46.269216 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6b4f2-9036-45be-8565-932170debffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:46.287292 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-cba6b4f2-9036-45be-8565-932170debffe None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:46.288503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-cba6b4f2-9036-45be-8565-932170debffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:46.299342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 711/1399] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:46.355299 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934e06b-113d-4374-8a80-e84a38e470d5 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:46.355584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934e06b-113d-4374-8a80-e84a38e470d5 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:46.355867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934e06b-113d-4374-8a80-e84a38e470d5 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:46.357267 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 689/1400] 10.222.0.13 () {54 vars in 962 bytes} [Tue Jul 5 10:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:46.362715 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4ba3-bb04-47c1-8173-192639848f79 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:46.363009 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4ba3-bb04-47c1-8173-192639848f79 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:46.363292 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4ba3-bb04-47c1-8173-192639848f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:46.411642 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f20f4ba3-bb04-47c1-8173-192639848f79 None None] MFA Rules not processed for user `a7d1be247c09473ab5f4ac224347a359`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:46.412840 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f20f4ba3-bb04-47c1-8173-192639848f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:46.471883 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 712/1401] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Jul 5 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:46.480111 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934e06b-113d-4374-8a80-e84a38e470d5 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:46.491101 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934e06b-113d-4374-8a80-e84a38e470d5 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:46.494998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c1db2-db22-4be9-9bc3-4e0f8422217d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d1be247c09473ab5f4ac224347a359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:46.495636 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c1db2-db22-4be9-9bc3-4e0f8422217d service glance] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:46.495917 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c1db2-db22-4be9-9bc3-4e0f8422217d service glance] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:46.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c1db2-db22-4be9-9bc3-4e0f8422217d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:46.505742 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c1db2-db22-4be9-9bc3-4e0f8422217d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:46.507161 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c1db2-db22-4be9-9bc3-4e0f8422217d service glance] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:46.517356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 690/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:47.218236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311b594-b529-4981-81ff-f791c847f837 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:47.219330 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311b594-b529-4981-81ff-f791c847f837 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:47.219430 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311b594-b529-4981-81ff-f791c847f837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:47.266867 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5311b594-b529-4981-81ff-f791c847f837 None None] MFA Rules not processed for user `f2683e79ea804a7987642df32f03fad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:47.268056 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5311b594-b529-4981-81ff-f791c847f837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:47.311083 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:07:47.335144 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 713/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:47.379375 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e021943-8f3b-4133-99e1-a8f4af52505d None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:47.379826 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e021943-8f3b-4133-99e1-a8f4af52505d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:47.379951 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e021943-8f3b-4133-99e1-a8f4af52505d None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:47.381414 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 691/1404] 10.222.0.13 () {54 vars in 942 bytes} [Tue Jul 5 10:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:47.387666 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8adad9-0477-4ed9-8547-66aa9a6ad05c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:47.387961 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8adad9-0477-4ed9-8547-66aa9a6ad05c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:47.388240 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8adad9-0477-4ed9-8547-66aa9a6ad05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:47.438378 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9a8adad9-0477-4ed9-8547-66aa9a6ad05c None None] MFA Rules not processed for user `1167f58a1ea3465083d67a94043066be`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:47.439493 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9a8adad9-0477-4ed9-8547-66aa9a6ad05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:47.512047 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 714/1405] 10.222.0.13 () {58 vars in 1039 bytes} [Tue Jul 5 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:07:47.521386 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e021943-8f3b-4133-99e1-a8f4af52505d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:47.534922 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e021943-8f3b-4133-99e1-a8f4af52505d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:47.539892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab28362-3d7c-4768-9c00-077826c7cb00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1167f58a1ea3465083d67a94043066be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:47.540522 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28362-3d7c-4768-9c00-077826c7cb00 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:47.540799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28362-3d7c-4768-9c00-077826c7cb00 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:47.541101 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28362-3d7c-4768-9c00-077826c7cb00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:47.550054 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab28362-3d7c-4768-9c00-077826c7cb00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:47.551927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab28362-3d7c-4768-9c00-077826c7cb00 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:47.559929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 692/1406] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 10:07:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 10:07:47.977904 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511d2b-2498-4d67-9334-18a915391b2c None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:47.978105 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511d2b-2498-4d67-9334-18a915391b2c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:47.978401 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511d2b-2498-4d67-9334-18a915391b2c None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:47.979929 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 715/1407] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:07:47.985849 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b580e-d6d1-4514-a86b-32b06639c372 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:47.986142 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b580e-d6d1-4514-a86b-32b06639c372 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:47.986419 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b580e-d6d1-4514-a86b-32b06639c372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:48.005899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2b4b580e-d6d1-4514-a86b-32b06639c372 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:07:48.007211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2b4b580e-d6d1-4514-a86b-32b06639c372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:07:48.018895 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 693/1408] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:07:48.063649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511d2b-2498-4d67-9334-18a915391b2c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:07:48.079946 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511d2b-2498-4d67-9334-18a915391b2c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:07:48.085583 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca88b2c-6e76-4403-b93a-adc5ae3779dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:07:48.086317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88b2c-6e76-4403-b93a-adc5ae3779dd service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:07:48.086643 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88b2c-6e76-4403-b93a-adc5ae3779dd service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:07:48.086983 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88b2c-6e76-4403-b93a-adc5ae3779dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:07:48.096344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca88b2c-6e76-4403-b93a-adc5ae3779dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:07:48.097996 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca88b2c-6e76-4403-b93a-adc5ae3779dd service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:07:48.110632 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 716/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:07:58.000849 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=69 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:07:58.104461 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=59 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:08:09.602297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142bbe7-2aea-4817-9dfe-98de1ed3f5af None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:09.602807 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142bbe7-2aea-4817-9dfe-98de1ed3f5af None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:09.602807 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142bbe7-2aea-4817-9dfe-98de1ed3f5af None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:09.604166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 694/1410] 10.222.0.13 () {54 vars in 918 bytes} [Tue Jul 5 10:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:09.609287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e252e-f6d4-4785-a5e0-da4a00260821 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:09.609758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e252e-f6d4-4785-a5e0-da4a00260821 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:09.609869 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e252e-f6d4-4785-a5e0-da4a00260821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:09.627206 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-658e252e-f6d4-4785-a5e0-da4a00260821 None None] MFA Rules not processed for user `2df8f75ab3ab4468afdd39e7b8e4793f`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:09.628382 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-658e252e-f6d4-4785-a5e0-da4a00260821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:09.636958 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 717/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Jul 5 10:08:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:09.651024 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ea2b4-893e-4db7-807f-50c4e35f7fc0 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:09.651313 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ea2b4-893e-4db7-807f-50c4e35f7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:09.651595 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ea2b4-893e-4db7-807f-50c4e35f7fc0 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:09.652936 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 695/1412] 10.222.0.13 () {54 vars in 918 bytes} [Tue Jul 5 10:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:09.657941 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46413a6-67be-4745-a634-1aea8968a296 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:09.658235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46413a6-67be-4745-a634-1aea8968a296 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:09.658517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46413a6-67be-4745-a634-1aea8968a296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:09.675330 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a46413a6-67be-4745-a634-1aea8968a296 None None] MFA Rules not processed for user `1ff81129f179478d901b590a5be64f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:09.676720 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a46413a6-67be-4745-a634-1aea8968a296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:09.685652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 718/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Jul 5 10:08:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:12.121618 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b469b0-00b4-4bcd-8a87-1d883da67461 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:12.122198 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b469b0-00b4-4bcd-8a87-1d883da67461 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:12.122198 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b469b0-00b4-4bcd-8a87-1d883da67461 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:12.123529 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:12.129136 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0cd4-9fcc-461b-a958-69d039329cf9 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:12.129585 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0cd4-9fcc-461b-a958-69d039329cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:12.129692 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0cd4-9fcc-461b-a958-69d039329cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:12.147921 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ad6d0cd4-9fcc-461b-a958-69d039329cf9 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:12.149138 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ad6d0cd4-9fcc-461b-a958-69d039329cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:12.156971 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:12.200168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b469b0-00b4-4bcd-8a87-1d883da67461 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:12.215241 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b469b0-00b4-4bcd-8a87-1d883da67461 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:12.220622 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e1054-e73d-40de-8050-70f27430f996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:12.221289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1054-e73d-40de-8050-70f27430f996 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:12.221576 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1054-e73d-40de-8050-70f27430f996 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:12.221854 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1054-e73d-40de-8050-70f27430f996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:12.229766 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e1054-e73d-40de-8050-70f27430f996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:12.231332 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e1054-e73d-40de-8050-70f27430f996 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:12.240550 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 697/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:13.126631 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a01b-cf59-4bda-8cc0-2321a17ea744 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:13.126922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a01b-cf59-4bda-8cc0-2321a17ea744 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:13.127205 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a01b-cf59-4bda-8cc0-2321a17ea744 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:13.128588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:08:13.133596 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7640-644a-4a5e-841f-167e6e587fba None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:13.134056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7640-644a-4a5e-841f-167e6e587fba None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:13.134159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7640-644a-4a5e-841f-167e6e587fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:13.151663 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-db1a7640-644a-4a5e-841f-167e6e587fba None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:13.152873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-db1a7640-644a-4a5e-841f-167e6e587fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:13.161325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:13.309171 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a01b-cf59-4bda-8cc0-2321a17ea744 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:13.323844 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a01b-cf59-4bda-8cc0-2321a17ea744 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:13.329756 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada60f1-0b0a-48f8-88d5-437d3a100afa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:13.330395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada60f1-0b0a-48f8-88d5-437d3a100afa service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:13.330678 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada60f1-0b0a-48f8-88d5-437d3a100afa service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:13.330958 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada60f1-0b0a-48f8-88d5-437d3a100afa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:13.339124 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada60f1-0b0a-48f8-88d5-437d3a100afa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:13.340694 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada60f1-0b0a-48f8-88d5-437d3a100afa service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:13.350730 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 721/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:14.234710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c541d-5941-4132-955c-07e0fe0db408 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:14.235275 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c541d-5941-4132-955c-07e0fe0db408 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:14.235275 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c541d-5941-4132-955c-07e0fe0db408 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:14.236662 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:08:14.241571 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a038f-dd6b-421f-860d-9597e1ac656a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:14.241874 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a038f-dd6b-421f-860d-9597e1ac656a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:14.242165 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a038f-dd6b-421f-860d-9597e1ac656a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:14.260046 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b61a038f-dd6b-421f-860d-9597e1ac656a None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:14.261286 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b61a038f-dd6b-421f-860d-9597e1ac656a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:14.269589 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:14.421483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c541d-5941-4132-955c-07e0fe0db408 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:14.436287 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c541d-5941-4132-955c-07e0fe0db408 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:14.444365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fe185-058f-452c-9966-785c1222e01a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:14.445080 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe185-058f-452c-9966-785c1222e01a service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:14.445373 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe185-058f-452c-9966-785c1222e01a service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:14.445653 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe185-058f-452c-9966-785c1222e01a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:14.454740 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fe185-058f-452c-9966-785c1222e01a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:14.456321 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fe185-058f-452c-9966-785c1222e01a service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:14.465813 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 700/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:15.316165 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea89a6-5bcc-4b07-a757-4665f6d00f70 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:15.316621 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea89a6-5bcc-4b07-a757-4665f6d00f70 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:15.316713 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea89a6-5bcc-4b07-a757-4665f6d00f70 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:15.318135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:15.322907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b134b3a-f75f-41ab-b579-dbed2ea49324 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:15.323293 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b134b3a-f75f-41ab-b579-dbed2ea49324 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:15.323459 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b134b3a-f75f-41ab-b579-dbed2ea49324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:15.341934 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2b134b3a-f75f-41ab-b579-dbed2ea49324 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:15.343122 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2b134b3a-f75f-41ab-b579-dbed2ea49324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:15.350813 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:08:15.502329 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea89a6-5bcc-4b07-a757-4665f6d00f70 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:15.516485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea89a6-5bcc-4b07-a757-4665f6d00f70 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:15.521851 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8792f1-784a-433c-a33c-9a9591003f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:15.522477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8792f1-784a-433c-a33c-9a9591003f1d service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:15.522761 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8792f1-784a-433c-a33c-9a9591003f1d service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:15.523037 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8792f1-784a-433c-a33c-9a9591003f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:15.530997 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8792f1-784a-433c-a33c-9a9591003f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:15.532563 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8792f1-784a-433c-a33c-9a9591003f1d service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:15.541737 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 724/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:16.388201 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540ccd6-22dd-4999-ad6e-f6422429a9db None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:16.388703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540ccd6-22dd-4999-ad6e-f6422429a9db None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:16.388800 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540ccd6-22dd-4999-ad6e-f6422429a9db None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:16.390197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:16.395114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73174f6c-42bd-451b-95d3-e820a9c29f2f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:16.395524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73174f6c-42bd-451b-95d3-e820a9c29f2f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:16.395688 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73174f6c-42bd-451b-95d3-e820a9c29f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:16.413184 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-73174f6c-42bd-451b-95d3-e820a9c29f2f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:16.414377 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-73174f6c-42bd-451b-95d3-e820a9c29f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:16.422619 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:16.572835 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540ccd6-22dd-4999-ad6e-f6422429a9db None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:16.586975 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540ccd6-22dd-4999-ad6e-f6422429a9db None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:16.592384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e7501-fb1f-46f8-b181-9b757c6e5484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:16.593053 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7501-fb1f-46f8-b181-9b757c6e5484 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:16.593342 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7501-fb1f-46f8-b181-9b757c6e5484 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:16.594114 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7501-fb1f-46f8-b181-9b757c6e5484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:16.602358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e7501-fb1f-46f8-b181-9b757c6e5484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:16.603944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e7501-fb1f-46f8-b181-9b757c6e5484 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:16.613884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 703/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:17.420403 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aca4c7-7c04-4368-a43f-f5a6a6a895c5 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:17.421013 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aca4c7-7c04-4368-a43f-f5a6a6a895c5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:17.421013 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aca4c7-7c04-4368-a43f-f5a6a6a895c5 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:17.422379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:17.427404 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb7163-c8ee-44cd-a03e-759b38aa11fe None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:17.427860 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb7163-c8ee-44cd-a03e-759b38aa11fe None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:17.427967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb7163-c8ee-44cd-a03e-759b38aa11fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:17.446715 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-70cb7163-c8ee-44cd-a03e-759b38aa11fe None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:17.447915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-70cb7163-c8ee-44cd-a03e-759b38aa11fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:17.456263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:17.604000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aca4c7-7c04-4368-a43f-f5a6a6a895c5 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:17.617912 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aca4c7-7c04-4368-a43f-f5a6a6a895c5 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:17.623228 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ce08e-c990-403a-8c7e-1eb1ed74ad98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:17.623857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce08e-c990-403a-8c7e-1eb1ed74ad98 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:17.624139 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce08e-c990-403a-8c7e-1eb1ed74ad98 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:17.624417 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce08e-c990-403a-8c7e-1eb1ed74ad98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:17.632765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ce08e-c990-403a-8c7e-1eb1ed74ad98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:17.634364 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ce08e-c990-403a-8c7e-1eb1ed74ad98 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:17.644045 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 727/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:18.444312 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293b07-aaa5-426f-a4db-7371b6140607 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:18.455462 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293b07-aaa5-426f-a4db-7371b6140607 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:18.455462 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293b07-aaa5-426f-a4db-7371b6140607 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:18.455462 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:08:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:18.455761 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018772d-cd9e-4ddf-8433-26e94433ff1c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:18.456141 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018772d-cd9e-4ddf-8433-26e94433ff1c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:18.456237 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018772d-cd9e-4ddf-8433-26e94433ff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:18.474405 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f018772d-cd9e-4ddf-8433-26e94433ff1c None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:18.475597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f018772d-cd9e-4ddf-8433-26e94433ff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:18.483339 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:18.631885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3293b07-aaa5-426f-a4db-7371b6140607 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:18.646385 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3293b07-aaa5-426f-a4db-7371b6140607 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:18.651646 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f8061-848e-4585-b608-fd837779a976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:18.652271 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8061-848e-4585-b608-fd837779a976 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:18.652549 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8061-848e-4585-b608-fd837779a976 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:18.652820 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8061-848e-4585-b608-fd837779a976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:18.661328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f8061-848e-4585-b608-fd837779a976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:18.662889 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f8061-848e-4585-b608-fd837779a976 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:18.671999 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 706/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:19.466999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c0761-ee4b-4aa2-8316-496bbc2fffc2 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:19.467644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c0761-ee4b-4aa2-8316-496bbc2fffc2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:19.467644 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c0761-ee4b-4aa2-8316-496bbc2fffc2 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:19.469561 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:08:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:19.474351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161b94-288d-4838-9c6c-ccb82b2fb9de None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:19.474762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161b94-288d-4838-9c6c-ccb82b2fb9de None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:19.474912 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161b94-288d-4838-9c6c-ccb82b2fb9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:19.492607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-76161b94-288d-4838-9c6c-ccb82b2fb9de None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:19.493828 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-76161b94-288d-4838-9c6c-ccb82b2fb9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:19.501546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:19.652656 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c0761-ee4b-4aa2-8316-496bbc2fffc2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:19.666561 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c0761-ee4b-4aa2-8316-496bbc2fffc2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:19.671857 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62aadd-7ddf-4f5d-a431-754d2ed713d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:19.672483 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62aadd-7ddf-4f5d-a431-754d2ed713d1 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:19.672766 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62aadd-7ddf-4f5d-a431-754d2ed713d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:19.673075 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62aadd-7ddf-4f5d-a431-754d2ed713d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:19.681192 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62aadd-7ddf-4f5d-a431-754d2ed713d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:19.682759 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62aadd-7ddf-4f5d-a431-754d2ed713d1 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:19.692421 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 730/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:20.493084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89221a1-ce00-4289-8155-f44835a87cdb None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:20.493615 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89221a1-ce00-4289-8155-f44835a87cdb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:20.493733 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89221a1-ce00-4289-8155-f44835a87cdb None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:20.495084 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:20.500016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7ec00-2435-4037-be89-56d57a8faa3c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:20.500450 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7ec00-2435-4037-be89-56d57a8faa3c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:20.500589 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7ec00-2435-4037-be89-56d57a8faa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:20.518122 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a9a7ec00-2435-4037-be89-56d57a8faa3c None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:20.519319 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a9a7ec00-2435-4037-be89-56d57a8faa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:20.527020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:08:20.677226 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89221a1-ce00-4289-8155-f44835a87cdb None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:20.691291 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89221a1-ce00-4289-8155-f44835a87cdb None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:20.696725 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0983e9-cbd9-4ff4-ab13-25eb458c2ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:20.697398 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0983e9-cbd9-4ff4-ab13-25eb458c2ead service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:20.697712 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0983e9-cbd9-4ff4-ab13-25eb458c2ead service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:20.697991 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0983e9-cbd9-4ff4-ab13-25eb458c2ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:20.706762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0983e9-cbd9-4ff4-ab13-25eb458c2ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:20.708371 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0983e9-cbd9-4ff4-ab13-25eb458c2ead service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:20.717705 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 709/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:22.635379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3798b2-25f8-4164-b2cb-dc19019e10c1 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:22.635987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3798b2-25f8-4164-b2cb-dc19019e10c1 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:22.635987 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3798b2-25f8-4164-b2cb-dc19019e10c1 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:22.637353 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:22.643148 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c1033-c6ed-4bd0-b8c7-49f200633a4d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:22.643545 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c1033-c6ed-4bd0-b8c7-49f200633a4d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:22.643705 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c1033-c6ed-4bd0-b8c7-49f200633a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:22.660882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-e62c1033-c6ed-4bd0-b8c7-49f200633a4d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:22.662096 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-e62c1033-c6ed-4bd0-b8c7-49f200633a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:22.669828 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:22.708303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3798b2-25f8-4164-b2cb-dc19019e10c1 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:22.718837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3798b2-25f8-4164-b2cb-dc19019e10c1 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:22.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771fec5-e1b3-4afb-9c92-8a7e50533d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:22.722950 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771fec5-e1b3-4afb-9c92-8a7e50533d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:22.723238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771fec5-e1b3-4afb-9c92-8a7e50533d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:22.723516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771fec5-e1b3-4afb-9c92-8a7e50533d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:22.732239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771fec5-e1b3-4afb-9c92-8a7e50533d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:22.733701 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771fec5-e1b3-4afb-9c92-8a7e50533d8a service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:22.742992 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 733/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:24.994207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec648102-a4db-4761-a980-410526eea8bc None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:24.994768 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec648102-a4db-4761-a980-410526eea8bc None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:24.994768 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec648102-a4db-4761-a980-410526eea8bc None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:24.996118 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:25.001923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788928-fd02-48ef-bd34-b4e54e1b8c2d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:25.002358 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788928-fd02-48ef-bd34-b4e54e1b8c2d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:25.002467 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788928-fd02-48ef-bd34-b4e54e1b8c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:25.020374 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d6788928-fd02-48ef-bd34-b4e54e1b8c2d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:25.021584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d6788928-fd02-48ef-bd34-b4e54e1b8c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:25.029314 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:25.067200 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec648102-a4db-4761-a980-410526eea8bc None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:25.068879 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ec648102-a4db-4761-a980-410526eea8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:25.082135 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec648102-a4db-4761-a980-410526eea8bc None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:25.085584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48597d9b-6dab-4a25-8d77-b10462647dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:25.086205 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597d9b-6dab-4a25-8d77-b10462647dfa service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:25.086484 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597d9b-6dab-4a25-8d77-b10462647dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:25.086755 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597d9b-6dab-4a25-8d77-b10462647dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:25.095365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48597d9b-6dab-4a25-8d77-b10462647dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:25.096779 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48597d9b-6dab-4a25-8d77-b10462647dfa service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:25.105893 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 712/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:27.419172 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c96e-b478-4c3e-bb49-d4a0dc413d43 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:27.419747 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c96e-b478-4c3e-bb49-d4a0dc413d43 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:27.419862 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c96e-b478-4c3e-bb49-d4a0dc413d43 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:27.421273 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:27.427413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17f12c-5172-47d6-963a-468b69bf6c47 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:27.427862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17f12c-5172-47d6-963a-468b69bf6c47 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:27.427968 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17f12c-5172-47d6-963a-468b69bf6c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:27.445199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-8d17f12c-5172-47d6-963a-468b69bf6c47 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:27.446379 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8d17f12c-5172-47d6-963a-468b69bf6c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:27.454488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:08:27.492398 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420c96e-b478-4c3e-bb49-d4a0dc413d43 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:27.502895 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420c96e-b478-4c3e-bb49-d4a0dc413d43 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:27.506376 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738ec80-4f19-47ce-b06a-247f1ce71152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:27.507007 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738ec80-4f19-47ce-b06a-247f1ce71152 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:27.507290 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738ec80-4f19-47ce-b06a-247f1ce71152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:27.507569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738ec80-4f19-47ce-b06a-247f1ce71152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:27.516861 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738ec80-4f19-47ce-b06a-247f1ce71152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:27.518328 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738ec80-4f19-47ce-b06a-247f1ce71152 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:27.527556 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 736/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:29.658364 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300841-afd4-44c8-b330-edbab4130ccb None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:29.658907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300841-afd4-44c8-b330-edbab4130ccb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:29.658907 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300841-afd4-44c8-b330-edbab4130ccb None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:29.660224 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:29.665398 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7597f9-ae60-49bd-b0bf-e7c10d7e6d54 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:29.665800 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7597f9-ae60-49bd-b0bf-e7c10d7e6d54 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:29.665959 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7597f9-ae60-49bd-b0bf-e7c10d7e6d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:29.684730 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ba7597f9-ae60-49bd-b0bf-e7c10d7e6d54 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:29.685946 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ba7597f9-ae60-49bd-b0bf-e7c10d7e6d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:29.693633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:29.732330 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14300841-afd4-44c8-b330-edbab4130ccb None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:29.742775 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14300841-afd4-44c8-b330-edbab4130ccb None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:29.746250 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07c4db-da46-4b19-ab76-3198424f9fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:29.746875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c4db-da46-4b19-ab76-3198424f9fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:29.747160 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c4db-da46-4b19-ab76-3198424f9fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:29.747436 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c4db-da46-4b19-ab76-3198424f9fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:29.756059 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07c4db-da46-4b19-ab76-3198424f9fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:29.757517 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07c4db-da46-4b19-ab76-3198424f9fa0 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:29.767211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 715/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:31.827147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab5e1c-234c-42bd-8d68-a799f5a228cf None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:31.827712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab5e1c-234c-42bd-8d68-a799f5a228cf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:31.827810 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab5e1c-234c-42bd-8d68-a799f5a228cf None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:31.829266 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:31.834770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc2229-2f64-475b-9a4a-496a786c8b6d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:31.835212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc2229-2f64-475b-9a4a-496a786c8b6d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:31.835314 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc2229-2f64-475b-9a4a-496a786c8b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:31.854439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-bfdc2229-2f64-475b-9a4a-496a786c8b6d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:31.856480 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-bfdc2229-2f64-475b-9a4a-496a786c8b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:31.867240 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:31.904411 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab5e1c-234c-42bd-8d68-a799f5a228cf None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:31.915611 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab5e1c-234c-42bd-8d68-a799f5a228cf None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:31.919478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9fde8-6f11-4c3e-8ca3-54efdbedf8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:31.920111 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9fde8-6f11-4c3e-8ca3-54efdbedf8aa service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:31.920399 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9fde8-6f11-4c3e-8ca3-54efdbedf8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:31.920679 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9fde8-6f11-4c3e-8ca3-54efdbedf8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:31.930501 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9fde8-6f11-4c3e-8ca3-54efdbedf8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:31.931970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9fde8-6f11-4c3e-8ca3-54efdbedf8aa service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:31.941375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 739/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:34.036448 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7d54-b979-49bf-935b-5240dfd5705f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:34.037022 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7d54-b979-49bf-935b-5240dfd5705f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:34.037022 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7d54-b979-49bf-935b-5240dfd5705f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:34.038411 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:34.043599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b427e37-245e-4dce-9c92-f5b12016b9a5 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:34.044009 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b427e37-245e-4dce-9c92-f5b12016b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:34.044163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b427e37-245e-4dce-9c92-f5b12016b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:34.062688 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8b427e37-245e-4dce-9c92-f5b12016b9a5 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:34.064164 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8b427e37-245e-4dce-9c92-f5b12016b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:34.071854 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:34.110247 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba7d54-b979-49bf-935b-5240dfd5705f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:34.120964 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba7d54-b979-49bf-935b-5240dfd5705f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:34.124710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d5265-5308-409e-9ab1-260adea94328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:34.125383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d5265-5308-409e-9ab1-260adea94328 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:34.125671 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d5265-5308-409e-9ab1-260adea94328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:34.125977 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d5265-5308-409e-9ab1-260adea94328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:34.134951 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d5265-5308-409e-9ab1-260adea94328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:34.136374 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d5265-5308-409e-9ab1-260adea94328 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:34.145668 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 718/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:36.235287 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b5c6-38c5-4e77-a97c-64fb9286f22e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:36.235863 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b5c6-38c5-4e77-a97c-64fb9286f22e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:36.235863 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b5c6-38c5-4e77-a97c-64fb9286f22e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:36.237266 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:36.242453 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714496-8927-44ce-a11b-687e9de1a265 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:36.242875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714496-8927-44ce-a11b-687e9de1a265 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:36.243016 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714496-8927-44ce-a11b-687e9de1a265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:36.260589 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-04714496-8927-44ce-a11b-687e9de1a265 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:36.261812 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-04714496-8927-44ce-a11b-687e9de1a265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:36.270024 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:36.305990 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b5c6-38c5-4e77-a97c-64fb9286f22e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:36.317102 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b5c6-38c5-4e77-a97c-64fb9286f22e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:36.320538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bb0fc-4981-428d-88bf-834fedd6de9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:36.321210 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb0fc-4981-428d-88bf-834fedd6de9b service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:36.321499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb0fc-4981-428d-88bf-834fedd6de9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:36.321780 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb0fc-4981-428d-88bf-834fedd6de9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:36.331035 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bb0fc-4981-428d-88bf-834fedd6de9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:36.332458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bb0fc-4981-428d-88bf-834fedd6de9b service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:36.341619 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 742/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 10:08:38.390405 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab295dff-b5c3-45e6-8d82-729242c58c88 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:38.390956 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab295dff-b5c3-45e6-8d82-729242c58c88 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:38.391065 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab295dff-b5c3-45e6-8d82-729242c58c88 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:38.392434 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:38.397792 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dc717-8df8-4504-b73a-11a988f04c7d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:38.398201 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dc717-8df8-4504-b73a-11a988f04c7d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:38.398353 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dc717-8df8-4504-b73a-11a988f04c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:38.404299 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=79 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:08:38.416982 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f91dc717-8df8-4504-b73a-11a988f04c7d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:38.418181 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f91dc717-8df8-4504-b73a-11a988f04c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:38.425944 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:38.463120 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab295dff-b5c3-45e6-8d82-729242c58c88 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:38.468581 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=73 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:08:38.478340 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab295dff-b5c3-45e6-8d82-729242c58c88 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:38.481805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796b8df-c1ce-44dc-87e1-0b017cbf7c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:38.482433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796b8df-c1ce-44dc-87e1-0b017cbf7c81 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:38.482713 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796b8df-c1ce-44dc-87e1-0b017cbf7c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:38.482983 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796b8df-c1ce-44dc-87e1-0b017cbf7c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:38.495734 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796b8df-c1ce-44dc-87e1-0b017cbf7c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:38.496711 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796b8df-c1ce-44dc-87e1-0b017cbf7c81 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:38.506770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 721/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:40.574041 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f207c96-114d-4944-9e9f-0f2230af3672 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:40.574563 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f207c96-114d-4944-9e9f-0f2230af3672 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:40.574563 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f207c96-114d-4944-9e9f-0f2230af3672 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:40.575892 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:40.581319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a552db4-7e55-4df1-a159-ac54aa3748ac None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:40.581725 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a552db4-7e55-4df1-a159-ac54aa3748ac None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:40.581883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a552db4-7e55-4df1-a159-ac54aa3748ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:40.599526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-2a552db4-7e55-4df1-a159-ac54aa3748ac None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:40.600737 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2a552db4-7e55-4df1-a159-ac54aa3748ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:40.609179 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:40.644215 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f207c96-114d-4944-9e9f-0f2230af3672 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:40.654791 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f207c96-114d-4944-9e9f-0f2230af3672 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:40.658739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0dd2-502e-4608-937c-6bf05fdd03fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:40.659363 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0dd2-502e-4608-937c-6bf05fdd03fd service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:40.659649 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0dd2-502e-4608-937c-6bf05fdd03fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:40.659926 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0dd2-502e-4608-937c-6bf05fdd03fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:40.668665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d0dd2-502e-4608-937c-6bf05fdd03fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:40.670116 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d0dd2-502e-4608-937c-6bf05fdd03fd service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:40.680236 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 745/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:42.711579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ad02b-ded1-4fe3-80aa-59636bb4d7d1 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:42.712095 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ad02b-ded1-4fe3-80aa-59636bb4d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:42.712095 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ad02b-ded1-4fe3-80aa-59636bb4d7d1 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:42.713466 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:08:42.718594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8564261-57c7-403d-ab0d-fd1e4441621d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:42.718976 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8564261-57c7-403d-ab0d-fd1e4441621d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:42.719159 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8564261-57c7-403d-ab0d-fd1e4441621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:42.736922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c8564261-57c7-403d-ab0d-fd1e4441621d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:08:42.738097 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c8564261-57c7-403d-ab0d-fd1e4441621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:08:42.745778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:08:42.781817 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ad02b-ded1-4fe3-80aa-59636bb4d7d1 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:08:42.792269 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ad02b-ded1-4fe3-80aa-59636bb4d7d1 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:08:42.795770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e514d8-b6da-4201-916e-4adbc884f572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:08:42.796392 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e514d8-b6da-4201-916e-4adbc884f572 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:08:42.796677 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e514d8-b6da-4201-916e-4adbc884f572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:08:42.796982 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e514d8-b6da-4201-916e-4adbc884f572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:08:42.805927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e514d8-b6da-4201-916e-4adbc884f572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:08:42.807341 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e514d8-b6da-4201-916e-4adbc884f572 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:08:42.817068 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 724/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:08:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:08:52.732022 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=11 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:08:52.812996 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=14 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:09:02.993528 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fddbc1-38e0-4620-8207-d79e135bde53 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:02.994086 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fddbc1-38e0-4620-8207-d79e135bde53 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:02.994086 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fddbc1-38e0-4620-8207-d79e135bde53 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:02.995445 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 747/1471] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:09:03.001481 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da840-e753-4fae-ac3f-690613f94eaa None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:03.001899 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da840-e753-4fae-ac3f-690613f94eaa None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:03.002048 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da840-e753-4fae-ac3f-690613f94eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:03.019243 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-ba9da840-e753-4fae-ac3f-690613f94eaa None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:09:03.020451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-ba9da840-e753-4fae-ac3f-690613f94eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:09:03.028374 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 725/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:09:03.112389 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d6873-1731-4a5a-8cda-f3bb7b159c2c None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:03.112681 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d6873-1731-4a5a-8cda-f3bb7b159c2c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:03.112999 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d6873-1731-4a5a-8cda-f3bb7b159c2c None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:03.114355 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 748/1473] 10.222.0.13 () {54 vars in 962 bytes} [Tue Jul 5 10:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:09:03.119328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8f04-0810-4f4b-a7cd-67f9ccea435d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:03.119625 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8f04-0810-4f4b-a7cd-67f9ccea435d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:03.119914 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8f04-0810-4f4b-a7cd-67f9ccea435d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:03.137502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b84c8f04-0810-4f4b-a7cd-67f9ccea435d None None] MFA Rules not processed for user `a7d1be247c09473ab5f4ac224347a359`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:09:03.138704 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b84c8f04-0810-4f4b-a7cd-67f9ccea435d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:09:03.145185 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 726/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Tue Jul 5 10:09:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:09:03.152237 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d6873-1731-4a5a-8cda-f3bb7b159c2c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:09:03.164243 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d6873-1731-4a5a-8cda-f3bb7b159c2c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:09:03.167774 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c2ea2-9074-4fd6-8aa7-9a6a4de78fa2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d1be247c09473ab5f4ac224347a359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:09:03.168405 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c2ea2-9074-4fd6-8aa7-9a6a4de78fa2 service glance] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:03.168692 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c2ea2-9074-4fd6-8aa7-9a6a4de78fa2 service glance] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:03.169003 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c2ea2-9074-4fd6-8aa7-9a6a4de78fa2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:03.179459 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c2ea2-9074-4fd6-8aa7-9a6a4de78fa2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:09:03.180881 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c2ea2-9074-4fd6-8aa7-9a6a4de78fa2 service glance] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:09:03.190231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 749/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 10:09:05.283559 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec8efd-9941-4f7d-9495-131edb703a29 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:05.284143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec8efd-9941-4f7d-9495-131edb703a29 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:05.284143 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec8efd-9941-4f7d-9495-131edb703a29 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:05.285534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 727/1476] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:09:05.291011 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c063cc4-d549-40f3-8cb9-1bd9711598e5 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:05.291487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c063cc4-d549-40f3-8cb9-1bd9711598e5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:05.291593 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c063cc4-d549-40f3-8cb9-1bd9711598e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:05.309596 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2c063cc4-d549-40f3-8cb9-1bd9711598e5 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:09:05.311305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2c063cc4-d549-40f3-8cb9-1bd9711598e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:09:05.318990 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 750/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:09:05.342761 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec8efd-9941-4f7d-9495-131edb703a29 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:09:05.355101 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec8efd-9941-4f7d-9495-131edb703a29 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:09:05.359536 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c511bc1-c6a7-4337-8104-8525f6c82448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:09:05.360164 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c511bc1-c6a7-4337-8104-8525f6c82448 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:05.360451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c511bc1-c6a7-4337-8104-8525f6c82448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:05.360730 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c511bc1-c6a7-4337-8104-8525f6c82448 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:05.361497 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c511bc1-c6a7-4337-8104-8525f6c82448 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:09:05.363253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-2c511bc1-c6a7-4337-8104-8525f6c82448 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:09:05.363253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Jul 05 10:09:05.363253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: Jul 05 10:09:05.364386 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c511bc1-c6a7-4337-8104-8525f6c82448 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:09:05.383464 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 728/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Tue Jul 5 10:09:05 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:09:07.429214 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287547c-8e60-47ee-8815-1e8da9cd1b1d None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:07.429759 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287547c-8e60-47ee-8815-1e8da9cd1b1d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:07.429759 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287547c-8e60-47ee-8815-1e8da9cd1b1d None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:07.431185 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 751/1479] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:09:07.437155 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e5ca-0085-48e3-9bb9-5d9c8567f5f8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:07.437579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e5ca-0085-48e3-9bb9-5d9c8567f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:07.437725 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e5ca-0085-48e3-9bb9-5d9c8567f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:07.455097 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-4d36e5ca-0085-48e3-9bb9-5d9c8567f5f8 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:09:07.456293 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4d36e5ca-0085-48e3-9bb9-5d9c8567f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:09:07.464060 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 729/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:09:07.506600 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287547c-8e60-47ee-8815-1e8da9cd1b1d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:09:07.520577 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287547c-8e60-47ee-8815-1e8da9cd1b1d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:09:07.525852 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ece61a-b5ee-43fd-b148-a14e7ee609e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:09:07.526485 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ece61a-b5ee-43fd-b148-a14e7ee609e1 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:07.526772 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ece61a-b5ee-43fd-b148-a14e7ee609e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:07.527053 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ece61a-b5ee-43fd-b148-a14e7ee609e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:07.535410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ece61a-b5ee-43fd-b148-a14e7ee609e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:09:07.537025 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ece61a-b5ee-43fd-b148-a14e7ee609e1 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:09:07.554479 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 752/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:09:09.737474 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c59e4c-c348-40f7-9686-6dbab46ca87a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:09.738499 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c59e4c-c348-40f7-9686-6dbab46ca87a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:09.738499 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c59e4c-c348-40f7-9686-6dbab46ca87a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:09.739460 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 730/1482] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:09:09.744781 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e9fab-5f44-468a-9dae-aad6558cc2ab None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:09.745205 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e9fab-5f44-468a-9dae-aad6558cc2ab None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:09.745406 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e9fab-5f44-468a-9dae-aad6558cc2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:09.763736 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0a5e9fab-5f44-468a-9dae-aad6558cc2ab None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:09:09.764951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0a5e9fab-5f44-468a-9dae-aad6558cc2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:09:09.772564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 753/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:09:09.807934 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c59e4c-c348-40f7-9686-6dbab46ca87a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:09:09.820505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c59e4c-c348-40f7-9686-6dbab46ca87a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:09:09.829677 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a62fd-58f1-4abd-8b81-37bae4c77c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:09:09.830335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a62fd-58f1-4abd-8b81-37bae4c77c4e service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:09.830618 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a62fd-58f1-4abd-8b81-37bae4c77c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:09.830893 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a62fd-58f1-4abd-8b81-37bae4c77c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:09.840327 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a62fd-58f1-4abd-8b81-37bae4c77c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:09:09.842316 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a62fd-58f1-4abd-8b81-37bae4c77c4e service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:09:09.851840 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 731/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:09:11.909949 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4b9cd-c907-4841-b6bb-42d6ac81ce20 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:11.910476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4b9cd-c907-4841-b6bb-42d6ac81ce20 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:11.910601 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4b9cd-c907-4841-b6bb-42d6ac81ce20 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:11.911893 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 754/1485] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:09:11.916938 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325afde2-a6ab-434c-82dd-ea89dc3bfee1 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:11.917384 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325afde2-a6ab-434c-82dd-ea89dc3bfee1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:11.917533 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325afde2-a6ab-434c-82dd-ea89dc3bfee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:11.935147 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-325afde2-a6ab-434c-82dd-ea89dc3bfee1 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:09:11.936340 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-325afde2-a6ab-434c-82dd-ea89dc3bfee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:09:11.944117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 732/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:09:11.982456 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4b9cd-c907-4841-b6bb-42d6ac81ce20 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:09:11.993210 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4b9cd-c907-4841-b6bb-42d6ac81ce20 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:09:11.996620 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584c225-a0e0-46b5-ad9c-baba3a830ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:09:11.997289 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c225-a0e0-46b5-ad9c-baba3a830ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:11.997581 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c225-a0e0-46b5-ad9c-baba3a830ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:11.997863 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c225-a0e0-46b5-ad9c-baba3a830ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:12.006572 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584c225-a0e0-46b5-ad9c-baba3a830ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:09:12.007998 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584c225-a0e0-46b5-ad9c-baba3a830ae4 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:09:12.017956 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 755/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:09:14.229605 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21141429-032b-4d2b-8b20-8d5ac768772f None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:14.230169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21141429-032b-4d2b-8b20-8d5ac768772f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:14.230169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21141429-032b-4d2b-8b20-8d5ac768772f None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:14.231547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 733/1488] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:09:14.237076 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44722186-48b2-4a15-aed8-352440f5b00e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:14.237481 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44722186-48b2-4a15-aed8-352440f5b00e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:14.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44722186-48b2-4a15-aed8-352440f5b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:14.255515 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-44722186-48b2-4a15-aed8-352440f5b00e None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:09:14.256687 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-44722186-48b2-4a15-aed8-352440f5b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:09:14.264723 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 756/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:09:14.304411 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21141429-032b-4d2b-8b20-8d5ac768772f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:09:14.315763 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21141429-032b-4d2b-8b20-8d5ac768772f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:09:14.319325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f764755-97d0-4fe9-95da-9af578b9690a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:09:14.319954 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764755-97d0-4fe9-95da-9af578b9690a service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:14.320238 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764755-97d0-4fe9-95da-9af578b9690a service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:14.320514 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764755-97d0-4fe9-95da-9af578b9690a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:14.329394 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f764755-97d0-4fe9-95da-9af578b9690a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:09:14.330819 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f764755-97d0-4fe9-95da-9af578b9690a service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:09:14.340104 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 734/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:09:16.541731 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e0c60-19c9-40d3-a66d-a6d25b5bf651 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:16.542265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e0c60-19c9-40d3-a66d-a6d25b5bf651 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:16.542373 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e0c60-19c9-40d3-a66d-a6d25b5bf651 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:16.543675 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 757/1491] 10.222.0.13 () {54 vars in 926 bytes} [Tue Jul 5 10:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:09:16.548853 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab505b-bce4-4c11-b9f4-152ef4a4f17d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:16.549287 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab505b-bce4-4c11-b9f4-152ef4a4f17d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:16.549400 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab505b-bce4-4c11-b9f4-152ef4a4f17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:16.568328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6dab505b-bce4-4c11-b9f4-152ef4a4f17d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:09:16.569560 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6dab505b-bce4-4c11-b9f4-152ef4a4f17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:09:16.577865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 735/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Tue Jul 5 10:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:09:16.614996 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e0c60-19c9-40d3-a66d-a6d25b5bf651 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:09:16.625922 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e0c60-19c9-40d3-a66d-a6d25b5bf651 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:09:16.629324 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493058e0-923e-4c61-b448-3aa1a3fd361c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:09:16.629951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493058e0-923e-4c61-b448-3aa1a3fd361c service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:09:16.630234 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493058e0-923e-4c61-b448-3aa1a3fd361c service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:09:16.630507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493058e0-923e-4c61-b448-3aa1a3fd361c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:09:16.639604 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493058e0-923e-4c61-b448-3aa1a3fd361c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:09:16.641042 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493058e0-923e-4c61-b448-3aa1a3fd361c service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:09:16.650185 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 758/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:09:26.562711 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=33 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:09:26.646121 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=33 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:10:42.194559 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3deeb1-c64b-4b9b-b052-5cb982d9a94f None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.195113 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3deeb1-c64b-4b9b-b052-5cb982d9a94f None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.195113 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3deeb1-c64b-4b9b-b052-5cb982d9a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.213046 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-5c3deeb1-c64b-4b9b-b052-5cb982d9a94f None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:10:42.214275 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-5c3deeb1-c64b-4b9b-b052-5cb982d9a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:10:42.221999 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 736/1494] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:10:42.229831 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fa804-9bcc-45ee-a302-7a742c0507b8 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.230291 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fa804-9bcc-45ee-a302-7a742c0507b8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.230414 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fa804-9bcc-45ee-a302-7a742c0507b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.248627 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-049fa804-9bcc-45ee-a302-7a742c0507b8 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:10:42.249921 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-049fa804-9bcc-45ee-a302-7a742c0507b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:10:42.257667 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 759/1495] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:10:42.262758 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3deeb1-c64b-4b9b-b052-5cb982d9a94f None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:10:42.272188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3deeb1-c64b-4b9b-b052-5cb982d9a94f None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:10:42.276855 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef84d78-51f9-4ff2-8af1-7db12b07fd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:10:42.277543 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84d78-51f9-4ff2-8af1-7db12b07fd1e admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.277828 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84d78-51f9-4ff2-8af1-7db12b07fd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.278107 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84d78-51f9-4ff2-8af1-7db12b07fd1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.278834 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef84d78-51f9-4ff2-8af1-7db12b07fd1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:10:42.279144 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef84d78-51f9-4ff2-8af1-7db12b07fd1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:10:42.280188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-cef84d78-51f9-4ff2-8af1-7db12b07fd1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:42.280188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Jul 05 10:10:42.280188 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: Jul 05 10:10:42.281086 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef84d78-51f9-4ff2-8af1-7db12b07fd1e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:10:42.292650 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 737/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 10:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:10:42.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fa804-9bcc-45ee-a302-7a742c0507b8 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:10:42.310459 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fa804-9bcc-45ee-a302-7a742c0507b8 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:10:42.314949 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828ad9-dc89-45a2-99d3-04a886836b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:10:42.315598 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828ad9-dc89-45a2-99d3-04a886836b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.315882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828ad9-dc89-45a2-99d3-04a886836b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.316157 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828ad9-dc89-45a2-99d3-04a886836b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.316831 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70828ad9-dc89-45a2-99d3-04a886836b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:10:42.318614 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: WARNING py.warnings [None req-70828ad9-dc89-45a2-99d3-04a886836b0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:42.318614 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: warnings.warn(msg) Jul 05 10:10:42.318614 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: Jul 05 10:10:42.319811 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70828ad9-dc89-45a2-99d3-04a886836b0a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:10:42.364990 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 760/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 10:10:42 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:10:42.369157 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef84d78-51f9-4ff2-8af1-7db12b07fd1e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:10:42.379468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef84d78-51f9-4ff2-8af1-7db12b07fd1e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:10:42.434793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f17bd-10ca-4bde-bb88-e2e7efd35001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:10:42.435454 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f17bd-10ca-4bde-bb88-e2e7efd35001 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.435735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f17bd-10ca-4bde-bb88-e2e7efd35001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.436009 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f17bd-10ca-4bde-bb88-e2e7efd35001 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.436697 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f17bd-10ca-4bde-bb88-e2e7efd35001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:10:42.437748 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-3d9f17bd-10ca-4bde-bb88-e2e7efd35001 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:42.437748 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Jul 05 10:10:42.437748 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: Jul 05 10:10:42.438937 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f17bd-10ca-4bde-bb88-e2e7efd35001 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:10:42.458612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 738/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 10:10:42 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:10:42.462668 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828ad9-dc89-45a2-99d3-04a886836b0a admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:10:42.472677 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828ad9-dc89-45a2-99d3-04a886836b0a admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:10:42.477143 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcbf32-bb13-4c1b-8fd7-d0be4992a7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:10:42.477797 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcbf32-bb13-4c1b-8fd7-d0be4992a7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.478079 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcbf32-bb13-4c1b-8fd7-d0be4992a7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.478354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcbf32-bb13-4c1b-8fd7-d0be4992a7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.479067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcbf32-bb13-4c1b-8fd7-d0be4992a7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:10:42.480564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: WARNING py.warnings [None req-ccbcbf32-bb13-4c1b-8fd7-d0be4992a7d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:42.480564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: warnings.warn(msg) Jul 05 10:10:42.480564 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: Jul 05 10:10:42.481476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcbf32-bb13-4c1b-8fd7-d0be4992a7d5 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:10:42.493832 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 761/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:10:42.498119 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f17bd-10ca-4bde-bb88-e2e7efd35001 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:10:42.507736 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f17bd-10ca-4bde-bb88-e2e7efd35001 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:10:42.512251 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41003e22-14fe-4c34-aea6-85a26b4ed4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:10:42.512911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41003e22-14fe-4c34-aea6-85a26b4ed4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.513218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41003e22-14fe-4c34-aea6-85a26b4ed4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.513495 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41003e22-14fe-4c34-aea6-85a26b4ed4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.514218 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41003e22-14fe-4c34-aea6-85a26b4ed4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:10:42.515213 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-41003e22-14fe-4c34-aea6-85a26b4ed4f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:42.515213 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Jul 05 10:10:42.515213 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: Jul 05 10:10:42.516085 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41003e22-14fe-4c34-aea6-85a26b4ed4f2 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:10:42.529406 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 739/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:10:42.533100 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcbf32-bb13-4c1b-8fd7-d0be4992a7d5 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:10:42.543145 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcbf32-bb13-4c1b-8fd7-d0be4992a7d5 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:10:42.547589 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e6fa9-b258-4a21-a2e9-cfa7b76241b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:10:42.548454 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6fa9-b258-4a21-a2e9-cfa7b76241b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.548739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6fa9-b258-4a21-a2e9-cfa7b76241b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.549127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6fa9-b258-4a21-a2e9-cfa7b76241b4 admin admin] PATH_INFO: `/v3/projects/5efaf52b8ab64a448f2658734c6e8cfa/users/278db78671504349bcddc71835f2d788/roles/14df33950256418dae713180ece879af` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.565594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e6fa9-b258-4a21-a2e9-cfa7b76241b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efaf52b8ab64a448f2658734c6e8cfa, user_id=278db78671504349bcddc71835f2d788, role_id=14df33950256418dae713180ece879af)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:10:42.566613 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: WARNING py.warnings [None req-ec0e6fa9-b258-4a21-a2e9-cfa7b76241b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:42.566613 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: warnings.warn(msg) Jul 05 10:10:42.566613 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: Jul 05 10:10:42.568539 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e6fa9-b258-4a21-a2e9-cfa7b76241b4 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:10:42.581015 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 762/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 10:10:42 2022] PUT /identity/v3/projects/5efaf52b8ab64a448f2658734c6e8cfa/users/278db78671504349bcddc71835f2d788/roles/14df33950256418dae713180ece879af => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 10:10:42.592872 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee85e8-2729-4588-9122-3b318e806e71 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.593194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee85e8-2729-4588-9122-3b318e806e71 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.593468 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee85e8-2729-4588-9122-3b318e806e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.618971 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a5ee85e8-2729-4588-9122-3b318e806e71 None None] MFA Rules not processed for user `278db78671504349bcddc71835f2d788`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:10:42.620189 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a5ee85e8-2729-4588-9122-3b318e806e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:10:42.680784 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 740/1502] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:10:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:10:42.694306 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92eb67-9767-46b6-8c80-e373819bd62e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.694599 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92eb67-9767-46b6-8c80-e373819bd62e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.694906 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92eb67-9767-46b6-8c80-e373819bd62e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.696282 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 763/1503] 10.222.0.13 () {54 vars in 963 bytes} [Tue Jul 5 10:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:10:42.701445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d76e15-b8b5-443a-9e46-68d3842ec2d8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.701735 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d76e15-b8b5-443a-9e46-68d3842ec2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.702010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d76e15-b8b5-443a-9e46-68d3842ec2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.719751 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-41d76e15-b8b5-443a-9e46-68d3842ec2d8 None None] MFA Rules not processed for user `878b64982654402297d65a8ca4ad6ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:10:42.720860 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-41d76e15-b8b5-443a-9e46-68d3842ec2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:10:42.761965 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:10:42.770133 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 741/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Tue Jul 5 10:10:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:10:42.778158 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92eb67-9767-46b6-8c80-e373819bd62e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:10:42.788422 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92eb67-9767-46b6-8c80-e373819bd62e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:10:42.791873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64193d5-b1a8-4816-8be7-71d58db5c274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878b64982654402297d65a8ca4ad6ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:10:42.792492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64193d5-b1a8-4816-8be7-71d58db5c274 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.792771 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64193d5-b1a8-4816-8be7-71d58db5c274 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.793078 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64193d5-b1a8-4816-8be7-71d58db5c274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.801067 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64193d5-b1a8-4816-8be7-71d58db5c274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:10:42.802728 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64193d5-b1a8-4816-8be7-71d58db5c274 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:10:42.811725 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 764/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:10:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:10:42.852996 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593914f-bc52-42f2-8ff2-446ea4feb6f7 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.853292 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593914f-bc52-42f2-8ff2-446ea4feb6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.853574 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593914f-bc52-42f2-8ff2-446ea4feb6f7 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.854848 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 742/1506] 10.222.0.13 () {52 vars in 829 bytes} [Tue Jul 5 10:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:10:42.858305 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64193d5-b1a8-4816-8be7-71d58db5c274 service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:10:42.918217 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64193d5-b1a8-4816-8be7-71d58db5c274 service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:10:42.922685 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:10:42.923538 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:42.923818 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:42.924092 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] PATH_INFO: `/v3/users/278db78671504349bcddc71835f2d788` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:42.925282 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=278db78671504349bcddc71835f2d788)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:10:42.926549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: WARNING py.warnings [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:42.926549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: warnings.warn(msg) Jul 05 10:10:42.926549 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: Jul 05 10:10:42.927748 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:10:42.991543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '278db78671504349bcddc71835f2d788'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:10:43.009741 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '278db78671504349bcddc71835f2d788'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:10:43.022343 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '278db78671504349bcddc71835f2d788'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:10:43.023052 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '278db78671504349bcddc71835f2d788'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:10:43.023758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '278db78671504349bcddc71835f2d788'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:10:43.028191 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:10:43.039981 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 765/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 10:10:42 2022] DELETE /identity/v3/users/278db78671504349bcddc71835f2d788 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:10:43.045051 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa31f41-3228-48ea-ab44-0fc31347f393 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:43.045348 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa31f41-3228-48ea-ab44-0fc31347f393 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:43.045633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa31f41-3228-48ea-ab44-0fc31347f393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:43.065007 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-4aa31f41-3228-48ea-ab44-0fc31347f393 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:10:43.066456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4aa31f41-3228-48ea-ab44-0fc31347f393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:10:43.128394 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 743/1508] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:10:43.137904 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:10:43.139354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:10:43.195712 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76612-ca3f-4222-bb0a-3a3c5b2eddd0 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:10:43.199760 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bb250-1e20-47d1-8d41-507bcbf172b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:10:43.200407 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb250-1e20-47d1-8d41-507bcbf172b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:43.200697 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb250-1e20-47d1-8d41-507bcbf172b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:43.201024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb250-1e20-47d1-8d41-507bcbf172b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:43.209853 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bb250-1e20-47d1-8d41-507bcbf172b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:10:43.211293 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bb250-1e20-47d1-8d41-507bcbf172b2 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:10:43.221302 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 766/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:10:43.542580 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa31f41-3228-48ea-ab44-0fc31347f393 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:10:43.544027 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4aa31f41-3228-48ea-ab44-0fc31347f393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:10:43.556004 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa31f41-3228-48ea-ab44-0fc31347f393 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:10:43.561317 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:10:43.562219 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:10:43.562506 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:10:43.562778 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] PATH_INFO: `/v3/projects/5efaf52b8ab64a448f2658734c6e8cfa` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:10:43.563994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efaf52b8ab64a448f2658734c6e8cfa)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:10:43.565088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:43.565088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Jul 05 10:10:43.565088 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: Jul 05 10:10:43.566227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:10:43.626624 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efaf52b8ab64a448f2658734c6e8cfa', 'request_id': 'req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:10:43.636835 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efaf52b8ab64a448f2658734c6e8cfa', 'request_id': 'req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:10:43.651540 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efaf52b8ab64a448f2658734c6e8cfa', 'request_id': 'req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:10:43.662197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] The token cache is being invalidate because project 5efaf52b8ab64a448f2658734c6e8cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 10:10:43.662488 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:10:43.663123 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-2cd03c4a-5f1a-4b1c-92cf-537e495fd737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:10:43.664839 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 744/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 10:10:43 2022] DELETE /identity/v3/projects/5efaf52b8ab64a448f2658734c6e8cfa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:10:53.217144 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:10:53.659229 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:11:55.358280 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8246-7588-4e0b-90f3-2b59ad9c8c22 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:11:55.358834 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8246-7588-4e0b-90f3-2b59ad9c8c22 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:11:55.358834 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8246-7588-4e0b-90f3-2b59ad9c8c22 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:11:55.360239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:11:55.364991 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309303f0-c039-44f7-8b82-bd6e5d2c3df7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:11:55.365439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309303f0-c039-44f7-8b82-bd6e5d2c3df7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:11:55.365542 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309303f0-c039-44f7-8b82-bd6e5d2c3df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:11:55.383235 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-309303f0-c039-44f7-8b82-bd6e5d2c3df7 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:11:55.384444 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-309303f0-c039-44f7-8b82-bd6e5d2c3df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:11:55.443542 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:11:55.598925 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a8246-7588-4e0b-90f3-2b59ad9c8c22 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:11:55.600608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e18a8246-7588-4e0b-90f3-2b59ad9c8c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:11:55.672566 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a8246-7588-4e0b-90f3-2b59ad9c8c22 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:11:55.678410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a161dc9-f847-40cb-826f-dc77e8761e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:11:55.679057 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a161dc9-f847-40cb-826f-dc77e8761e33 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:11:55.679342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a161dc9-f847-40cb-826f-dc77e8761e33 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:11:55.679622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a161dc9-f847-40cb-826f-dc77e8761e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:11:55.688161 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a161dc9-f847-40cb-826f-dc77e8761e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:11:55.689769 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a161dc9-f847-40cb-826f-dc77e8761e33 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:11:55.698993 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 768/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:11:56.522865 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914b454-091a-43cc-a0e7-1c39e94292a8 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:11:56.523439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914b454-091a-43cc-a0e7-1c39e94292a8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:11:56.523439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914b454-091a-43cc-a0e7-1c39e94292a8 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:11:56.524789 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:11:56.530063 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c073-43e6-46fd-a28c-7797b4b50270 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:11:56.530477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c073-43e6-46fd-a28c-7797b4b50270 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:11:56.530637 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c073-43e6-46fd-a28c-7797b4b50270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:11:56.549284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f746c073-43e6-46fd-a28c-7797b4b50270 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:11:56.550428 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f746c073-43e6-46fd-a28c-7797b4b50270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:11:56.558790 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:11:56.709583 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914b454-091a-43cc-a0e7-1c39e94292a8 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:11:56.724395 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914b454-091a-43cc-a0e7-1c39e94292a8 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:11:56.729933 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1955492-b15d-4008-bdae-47efc1bc35c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:11:56.730598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955492-b15d-4008-bdae-47efc1bc35c4 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:11:56.730884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955492-b15d-4008-bdae-47efc1bc35c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:11:56.731166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1955492-b15d-4008-bdae-47efc1bc35c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:11:56.739206 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1955492-b15d-4008-bdae-47efc1bc35c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:11:56.740810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1955492-b15d-4008-bdae-47efc1bc35c4 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:11:56.750221 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 747/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:11:59.689691 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78709-0c8c-45df-a2cb-0ba3e2f0c1e3 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:11:59.690245 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78709-0c8c-45df-a2cb-0ba3e2f0c1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:11:59.690245 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78709-0c8c-45df-a2cb-0ba3e2f0c1e3 None None] PATH_INFO: `/v3` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:11:59.691484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 770/1517] 10.222.0.33 () {54 vars in 925 bytes} [Tue Jul 5 10:11:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 10:11:59.699281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd5b3-3359-46dd-a8c0-01f8d01e70fb None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:11:59.699681 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd5b3-3359-46dd-a8c0-01f8d01e70fb None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:11:59.699840 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd5b3-3359-46dd-a8c0-01f8d01e70fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:11:59.717299 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-776fd5b3-3359-46dd-a8c0-01f8d01e70fb None None] MFA Rules not processed for user `2df8f75ab3ab4468afdd39e7b8e4793f`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:11:59.718489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-776fd5b3-3359-46dd-a8c0-01f8d01e70fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:11:59.778793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 748/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Jul 5 10:11:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:12:06.543442 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=37 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:07.985778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98847294-0ae0-4dce-9887-5d8ea64067d2 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:07.986440 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98847294-0ae0-4dce-9887-5d8ea64067d2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:07.986440 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98847294-0ae0-4dce-9887-5d8ea64067d2 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:07.987736 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 771/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:12:07.992612 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034238d8-a4d2-464d-86cd-37c8d0c798ea None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:07.993043 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034238d8-a4d2-464d-86cd-37c8d0c798ea None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:07.993216 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034238d8-a4d2-464d-86cd-37c8d0c798ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:08.011292 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-034238d8-a4d2-464d-86cd-37c8d0c798ea None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:12:08.013092 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-034238d8-a4d2-464d-86cd-37c8d0c798ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:12:08.020805 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 749/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:12:08.172344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98847294-0ae0-4dce-9887-5d8ea64067d2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:12:08.187755 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98847294-0ae0-4dce-9887-5d8ea64067d2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:12:08.202584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be93f-334f-47ea-a06f-ac2706a90b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:12:08.203251 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be93f-334f-47ea-a06f-ac2706a90b1e service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:08.203536 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be93f-334f-47ea-a06f-ac2706a90b1e service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:08.203814 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be93f-334f-47ea-a06f-ac2706a90b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:08.212826 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64be93f-334f-47ea-a06f-ac2706a90b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:12:08.214568 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64be93f-334f-47ea-a06f-ac2706a90b1e service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:12:08.224348 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 772/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:12:08.568689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e079d-7bd8-47da-8027-62e317bf5bed None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:08.569025 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e079d-7bd8-47da-8027-62e317bf5bed None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:08.569312 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e079d-7bd8-47da-8027-62e317bf5bed None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:08.570726 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 750/1522] 10.222.0.13 () {54 vars in 960 bytes} [Tue Jul 5 10:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:12:08.576354 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f9c06-40f0-47b7-8f29-00d998cc2aa3 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:08.576742 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f9c06-40f0-47b7-8f29-00d998cc2aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:08.577118 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f9c06-40f0-47b7-8f29-00d998cc2aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:08.595370 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ae1f9c06-40f0-47b7-8f29-00d998cc2aa3 None None] MFA Rules not processed for user `2df8f75ab3ab4468afdd39e7b8e4793f`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:12:08.596634 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ae1f9c06-40f0-47b7-8f29-00d998cc2aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:12:08.605477 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 773/1523] 10.222.0.13 () {58 vars in 1057 bytes} [Tue Jul 5 10:12:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:12:08.612788 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e079d-7bd8-47da-8027-62e317bf5bed None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:12:08.625781 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e079d-7bd8-47da-8027-62e317bf5bed None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:12:08.630673 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72b5b7-d051-4956-a7b1-7ae89e38c4d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df8f75ab3ab4468afdd39e7b8e4793f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:12:08.631301 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72b5b7-d051-4956-a7b1-7ae89e38c4d3 service placement] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:08.631579 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72b5b7-d051-4956-a7b1-7ae89e38c4d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:08.631852 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72b5b7-d051-4956-a7b1-7ae89e38c4d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:08.640673 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72b5b7-d051-4956-a7b1-7ae89e38c4d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:12:08.642294 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72b5b7-d051-4956-a7b1-7ae89e38c4d3 service placement] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:12:08.652621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 751/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:12:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:12:09.044544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186a64-f618-41c0-aaab-b0a67b6b0047 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:09.045123 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186a64-f618-41c0-aaab-b0a67b6b0047 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:09.045123 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186a64-f618-41c0-aaab-b0a67b6b0047 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:09.046503 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 774/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 10:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:12:09.051253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb8a9c-daa8-44db-8d3f-524f1e1826d8 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:09.051689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb8a9c-daa8-44db-8d3f-524f1e1826d8 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:09.052112 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb8a9c-daa8-44db-8d3f-524f1e1826d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:09.071017 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-cfeb8a9c-daa8-44db-8d3f-524f1e1826d8 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:12:09.072217 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-cfeb8a9c-daa8-44db-8d3f-524f1e1826d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:12:09.080160 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 752/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 10:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:12:09.233492 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba186a64-f618-41c0-aaab-b0a67b6b0047 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:12:09.249130 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba186a64-f618-41c0-aaab-b0a67b6b0047 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:12:09.254384 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb4858-a76b-4e7e-9dfa-5d74b9bb32bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:12:09.255020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4858-a76b-4e7e-9dfa-5d74b9bb32bf service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:09.255308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4858-a76b-4e7e-9dfa-5d74b9bb32bf service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:09.255588 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4858-a76b-4e7e-9dfa-5d74b9bb32bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:09.263867 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb4858-a76b-4e7e-9dfa-5d74b9bb32bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:12:09.265534 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb4858-a76b-4e7e-9dfa-5d74b9bb32bf service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:12:09.275135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 775/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 10:12:13.220494 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468705c-bc78-4ddc-ba89-88eb91eb7e21 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:13.221119 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468705c-bc78-4ddc-ba89-88eb91eb7e21 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:13.221119 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468705c-bc78-4ddc-ba89-88eb91eb7e21 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:13.222511 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 753/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:12:13.227572 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e40d4-8340-4a0d-a7ee-e0c082e8d036 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:13.227968 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e40d4-8340-4a0d-a7ee-e0c082e8d036 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:13.228119 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e40d4-8340-4a0d-a7ee-e0c082e8d036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:13.246045 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0e1e40d4-8340-4a0d-a7ee-e0c082e8d036 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:12:13.247228 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0e1e40d4-8340-4a0d-a7ee-e0c082e8d036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:12:13.254818 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 776/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:12:13.326884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468705c-bc78-4ddc-ba89-88eb91eb7e21 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:12:13.328660 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-7468705c-bc78-4ddc-ba89-88eb91eb7e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:12:13.385837 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468705c-bc78-4ddc-ba89-88eb91eb7e21 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:12:13.389344 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe50bb-65ed-47db-820b-9575f3722888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:12:13.389979 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe50bb-65ed-47db-820b-9575f3722888 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:13.390259 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe50bb-65ed-47db-820b-9575f3722888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:13.390533 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe50bb-65ed-47db-820b-9575f3722888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:13.399526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe50bb-65ed-47db-820b-9575f3722888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:12:13.401013 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe50bb-65ed-47db-820b-9575f3722888 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:12:13.406414 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:13.411641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 754/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:12:15.426098 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde52b02-2e36-4a00-9c00-12924cff2303 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:15.426646 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde52b02-2e36-4a00-9c00-12924cff2303 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:15.427020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde52b02-2e36-4a00-9c00-12924cff2303 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:15.428288 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 777/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:12:15.433558 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c4497-0a5c-4cf6-815c-7f32fcb1ec97 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:15.433952 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c4497-0a5c-4cf6-815c-7f32fcb1ec97 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:15.434108 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c4497-0a5c-4cf6-815c-7f32fcb1ec97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:15.452092 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-4a2c4497-0a5c-4cf6-815c-7f32fcb1ec97 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:12:15.453324 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-4a2c4497-0a5c-4cf6-815c-7f32fcb1ec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:12:15.461141 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 755/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:12:15.497416 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde52b02-2e36-4a00-9c00-12924cff2303 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:12:15.507914 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde52b02-2e36-4a00-9c00-12924cff2303 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:12:15.511431 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6de13a-5f46-429c-9d53-0a57c93e449d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:12:15.512064 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6de13a-5f46-429c-9d53-0a57c93e449d service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:15.512350 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6de13a-5f46-429c-9d53-0a57c93e449d service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:15.512629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6de13a-5f46-429c-9d53-0a57c93e449d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:15.521344 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6de13a-5f46-429c-9d53-0a57c93e449d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:12:15.522765 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6de13a-5f46-429c-9d53-0a57c93e449d service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:12:15.532512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 778/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 10:12:19.089528 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098f3a9-ef62-4c51-8bcb-aeefb5335e15 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:19.090110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098f3a9-ef62-4c51-8bcb-aeefb5335e15 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:19.090110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098f3a9-ef62-4c51-8bcb-aeefb5335e15 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:19.091490 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 756/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:12:19.096569 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368758b7-3726-4613-a2bc-8556d863617d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:19.097127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368758b7-3726-4613-a2bc-8556d863617d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:19.097235 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368758b7-3726-4613-a2bc-8556d863617d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:19.115342 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-368758b7-3726-4613-a2bc-8556d863617d None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:12:19.116533 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-368758b7-3726-4613-a2bc-8556d863617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:12:19.125048 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 779/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:12:19.431661 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098f3a9-ef62-4c51-8bcb-aeefb5335e15 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:12:19.433590 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-2098f3a9-ef62-4c51-8bcb-aeefb5335e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:12:19.490374 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098f3a9-ef62-4c51-8bcb-aeefb5335e15 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:12:19.493956 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf70fe-2d81-4a30-8970-b6872b4be9a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878b64982654402297d65a8ca4ad6ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:12:19.494597 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf70fe-2d81-4a30-8970-b6872b4be9a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:19.494885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf70fe-2d81-4a30-8970-b6872b4be9a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:19.495168 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf70fe-2d81-4a30-8970-b6872b4be9a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:19.503926 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf70fe-2d81-4a30-8970-b6872b4be9a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:12:19.505404 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf70fe-2d81-4a30-8970-b6872b4be9a5 service cinder] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:12:19.515126 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 757/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:12:21.570495 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fa6e-c93c-4fac-9cd3-bb69caf41412 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:21.571020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fa6e-c93c-4fac-9cd3-bb69caf41412 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:21.571020 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fa6e-c93c-4fac-9cd3-bb69caf41412 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:21.572353 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 780/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 10:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:12:21.577985 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1869b8-0023-4ea2-acd3-46d1fd1347e3 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:21.578414 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1869b8-0023-4ea2-acd3-46d1fd1347e3 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:21.578548 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1869b8-0023-4ea2-acd3-46d1fd1347e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:21.596584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-8e1869b8-0023-4ea2-acd3-46d1fd1347e3 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:12:21.597815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-8e1869b8-0023-4ea2-acd3-46d1fd1347e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:12:21.605716 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 758/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 10:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:12:21.904837 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998fa6e-c93c-4fac-9cd3-bb69caf41412 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:12:21.906590 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4998fa6e-c93c-4fac-9cd3-bb69caf41412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:12:21.920056 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998fa6e-c93c-4fac-9cd3-bb69caf41412 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:12:21.923603 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bd3c3-ea5b-4cf3-a67e-4e2158029239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878b64982654402297d65a8ca4ad6ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:12:21.924239 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bd3c3-ea5b-4cf3-a67e-4e2158029239 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:12:21.924563 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bd3c3-ea5b-4cf3-a67e-4e2158029239 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:12:21.924846 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bd3c3-ea5b-4cf3-a67e-4e2158029239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:12:21.934746 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bd3c3-ea5b-4cf3-a67e-4e2158029239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:12:21.936167 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bd3c3-ea5b-4cf3-a67e-4e2158029239 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:12:21.945633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 781/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:12:31.591489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=32 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:31.941478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=33 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:43.146941 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81dbef-0d3d-4d6f-a658-df66ea70b4b6 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.147553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81dbef-0d3d-4d6f-a658-df66ea70b4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.147553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81dbef-0d3d-4d6f-a658-df66ea70b4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.158308 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9f535-6016-47fb-bc0d-b3fbc6f27ca7 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.158802 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9f535-6016-47fb-bc0d-b3fbc6f27ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.158911 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9f535-6016-47fb-bc0d-b3fbc6f27ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.166328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-db81dbef-0d3d-4d6f-a658-df66ea70b4b6 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:43.167526 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-db81dbef-0d3d-4d6f-a658-df66ea70b4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:43.175665 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 759/1540] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:13:43.176959 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a6f9f535-6016-47fb-bc0d-b3fbc6f27ca7 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:43.178407 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a6f9f535-6016-47fb-bc0d-b3fbc6f27ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:43.183914 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1540-e446-4b09-a6dc-a894dfbe99a4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.184203 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1540-e446-4b09-a6dc-a894dfbe99a4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.184491 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1540-e446-4b09-a6dc-a894dfbe99a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.186873 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 782/1541] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:13:43.194529 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983f93-7a8b-4779-8ae8-a41597ef1fca None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.194918 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983f93-7a8b-4779-8ae8-a41597ef1fca None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.195205 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983f93-7a8b-4779-8ae8-a41597ef1fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.202953 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-45eb1540-e446-4b09-a6dc-a894dfbe99a4 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:43.204148 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-45eb1540-e446-4b09-a6dc-a894dfbe99a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:43.212237 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 760/1542] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:13:43.212853 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-84983f93-7a8b-4779-8ae8-a41597ef1fca None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:43.213970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-84983f93-7a8b-4779-8ae8-a41597ef1fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:43.217112 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1540-e446-4b09-a6dc-a894dfbe99a4 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.221908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 783/1543] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:13:43.225799 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1540-e446-4b09-a6dc-a894dfbe99a4 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.226047 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84983f93-7a8b-4779-8ae8-a41597ef1fca None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.231184 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65238a3-efb6-4970-b555-3b9dd8d9399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.231823 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65238a3-efb6-4970-b555-3b9dd8d9399e admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.232105 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65238a3-efb6-4970-b555-3b9dd8d9399e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.232381 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65238a3-efb6-4970-b555-3b9dd8d9399e admin admin] PATH_INFO: `/v3/domains` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.233117 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65238a3-efb6-4970-b555-3b9dd8d9399e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80360) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:13:43.233423 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65238a3-efb6-4970-b555-3b9dd8d9399e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.235020 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65238a3-efb6-4970-b555-3b9dd8d9399e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.235653 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84983f93-7a8b-4779-8ae8-a41597ef1fca None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.240143 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5c042-a36b-4c00-9061-5e7b66cd2cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.240780 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c042-a36b-4c00-9061-5e7b66cd2cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.241103 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c042-a36b-4c00-9061-5e7b66cd2cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.241382 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c042-a36b-4c00-9061-5e7b66cd2cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.242089 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5c042-a36b-4c00-9061-5e7b66cd2cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 10:13:43.242512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5c042-a36b-4c00-9061-5e7b66cd2cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.243526 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: WARNING py.warnings [None req-3dc5c042-a36b-4c00-9061-5e7b66cd2cbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:13:43.243526 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: warnings.warn(msg) Jul 05 10:13:43.243526 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: Jul 05 10:13:43.244437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5c042-a36b-4c00-9061-5e7b66cd2cbe admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.246368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 761/1544] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 10:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:13:43.254062 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65238a3-efb6-4970-b555-3b9dd8d9399e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.256219 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 784/1545] 10.222.0.13 () {58 vars in 1152 bytes} [Tue Jul 5 10:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 10:13:43.263762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65238a3-efb6-4970-b555-3b9dd8d9399e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.263912 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5c042-a36b-4c00-9061-5e7b66cd2cbe admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.268195 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0917a2f-93d2-4ae9-9492-11f97f1a0048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.268828 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917a2f-93d2-4ae9-9492-11f97f1a0048 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.269138 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917a2f-93d2-4ae9-9492-11f97f1a0048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.269415 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917a2f-93d2-4ae9-9492-11f97f1a0048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.270092 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0917a2f-93d2-4ae9-9492-11f97f1a0048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.271104 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-f0917a2f-93d2-4ae9-9492-11f97f1a0048 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:13:43.271104 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Jul 05 10:13:43.271104 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: Jul 05 10:13:43.272273 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0917a2f-93d2-4ae9-9492-11f97f1a0048 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.273394 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5c042-a36b-4c00-9061-5e7b66cd2cbe admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.278436 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0249b-c397-49fd-b048-38b1f110bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.279071 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0249b-c397-49fd-b048-38b1f110bd33 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.279358 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0249b-c397-49fd-b048-38b1f110bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.279635 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0249b-c397-49fd-b048-38b1f110bd33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.280412 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0249b-c397-49fd-b048-38b1f110bd33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.282358 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0249b-c397-49fd-b048-38b1f110bd33 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.302406 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 762/1546] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 10:13:43 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:13:43.306555 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0917a2f-93d2-4ae9-9492-11f97f1a0048 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.317736 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 785/1547] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 10:13:43 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:13:43.321757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0249b-c397-49fd-b048-38b1f110bd33 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.377770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0917a2f-93d2-4ae9-9492-11f97f1a0048 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.390272 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0249b-c397-49fd-b048-38b1f110bd33 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.394851 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77129ea8-a955-472b-abe4-4dc53501c855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.395524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77129ea8-a955-472b-abe4-4dc53501c855 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.395813 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77129ea8-a955-472b-abe4-4dc53501c855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.396100 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77129ea8-a955-472b-abe4-4dc53501c855 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.396779 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77129ea8-a955-472b-abe4-4dc53501c855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.397875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: WARNING py.warnings [None req-77129ea8-a955-472b-abe4-4dc53501c855 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:13:43.397875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: warnings.warn(msg) Jul 05 10:13:43.397875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: Jul 05 10:13:43.399042 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77129ea8-a955-472b-abe4-4dc53501c855 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.419725 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 786/1548] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 10:13:43 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:13:43.423645 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77129ea8-a955-472b-abe4-4dc53501c855 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.433276 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77129ea8-a955-472b-abe4-4dc53501c855 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.437717 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641ee0f-17ba-4dd7-8652-25090243c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.438183 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d05e7-3e54-4eae-9bb0-54da261fdc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.438355 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ee0f-17ba-4dd7-8652-25090243c67e admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.438639 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ee0f-17ba-4dd7-8652-25090243c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.438882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d05e7-3e54-4eae-9bb0-54da261fdc44 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ee0f-17ba-4dd7-8652-25090243c67e admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.439173 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d05e7-3e54-4eae-9bb0-54da261fdc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.439453 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d05e7-3e54-4eae-9bb0-54da261fdc44 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.439605 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641ee0f-17ba-4dd7-8652-25090243c67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.440131 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d05e7-3e54-4eae-9bb0-54da261fdc44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.441226 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641ee0f-17ba-4dd7-8652-25090243c67e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.442056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d05e7-3e54-4eae-9bb0-54da261fdc44 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.451016 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 787/1549] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 10:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 10:13:43.455018 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641ee0f-17ba-4dd7-8652-25090243c67e admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.464875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641ee0f-17ba-4dd7-8652-25090243c67e admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.468174 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 763/1550] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 10:13:43 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:13:43.469289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d05e7-3e54-4eae-9bb0-54da261fdc44 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.469427 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c947c-1bc0-4a59-b8ce-bcae7585d9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.470083 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c947c-1bc0-4a59-b8ce-bcae7585d9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.470369 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c947c-1bc0-4a59-b8ce-bcae7585d9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.470647 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c947c-1bc0-4a59-b8ce-bcae7585d9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.471351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c947c-1bc0-4a59-b8ce-bcae7585d9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.472947 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c947c-1bc0-4a59-b8ce-bcae7585d9fe admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.479352 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d05e7-3e54-4eae-9bb0-54da261fdc44 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.484081 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 788/1551] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 10:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 10:13:43.487573 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a12ac-06a6-4347-9a9f-62d5336d3d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.487954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c947c-1bc0-4a59-b8ce-bcae7585d9fe admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.488232 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a12ac-06a6-4347-9a9f-62d5336d3d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.488525 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a12ac-06a6-4347-9a9f-62d5336d3d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.488816 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a12ac-06a6-4347-9a9f-62d5336d3d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.489576 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a12ac-06a6-4347-9a9f-62d5336d3d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.491154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a12ac-06a6-4347-9a9f-62d5336d3d88 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.497460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c947c-1bc0-4a59-b8ce-bcae7585d9fe admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.501289 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 764/1552] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 10:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:13:43.502077 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb98cdc-8b66-4e81-a3a5-74fbafd5a14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.503000 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98cdc-8b66-4e81-a3a5-74fbafd5a14d admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.503351 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98cdc-8b66-4e81-a3a5-74fbafd5a14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.503692 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb98cdc-8b66-4e81-a3a5-74fbafd5a14d admin admin] PATH_INFO: `/v3/projects/98919277809c4001b09973988a46e6a4/users/a83acfc659cc4ba0ac4fb9b009fc2e6e/roles/14df33950256418dae713180ece879af` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.504984 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a12ac-06a6-4347-9a9f-62d5336d3d88 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.514770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a12ac-06a6-4347-9a9f-62d5336d3d88 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.518516 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb98cdc-8b66-4e81-a3a5-74fbafd5a14d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98919277809c4001b09973988a46e6a4, user_id=a83acfc659cc4ba0ac4fb9b009fc2e6e, role_id=14df33950256418dae713180ece879af)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.519381 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19024471-53c6-46da-b7d4-6f589ea27737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.520017 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024471-53c6-46da-b7d4-6f589ea27737 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.520306 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024471-53c6-46da-b7d4-6f589ea27737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.520588 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024471-53c6-46da-b7d4-6f589ea27737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.521166 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb98cdc-8b66-4e81-a3a5-74fbafd5a14d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.521335 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19024471-53c6-46da-b7d4-6f589ea27737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.522896 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19024471-53c6-46da-b7d4-6f589ea27737 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.534916 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 789/1553] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 10:13:43 2022] PUT /identity/v3/projects/98919277809c4001b09973988a46e6a4/users/a83acfc659cc4ba0ac4fb9b009fc2e6e/roles/14df33950256418dae713180ece879af => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 10:13:43.535102 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 765/1554] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 10:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:13:43.538889 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb98cdc-8b66-4e81-a3a5-74fbafd5a14d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.539390 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650e627-fa63-4dd2-899c-22058df363d6 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.539689 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650e627-fa63-4dd2-899c-22058df363d6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.539973 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650e627-fa63-4dd2-899c-22058df363d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.556808 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9650e627-fa63-4dd2-899c-22058df363d6 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:43.558072 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9650e627-fa63-4dd2-899c-22058df363d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:43.578781 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:43.595926 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:43.601052 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb98cdc-8b66-4e81-a3a5-74fbafd5a14d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.606960 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28565d6d-33e5-4c42-a989-ae6f3a7c0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.607852 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28565d6d-33e5-4c42-a989-ae6f3a7c0225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.608142 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28565d6d-33e5-4c42-a989-ae6f3a7c0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.608430 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28565d6d-33e5-4c42-a989-ae6f3a7c0225 admin admin] PATH_INFO: `/v3/projects/4fb4a14d03a043a19d11603f33376fb0/users/77b40a6f00ce4301a3022775c8ade8be/roles/14df33950256418dae713180ece879af` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.618181 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 766/1555] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:13:43.622991 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28565d6d-33e5-4c42-a989-ae6f3a7c0225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb4a14d03a043a19d11603f33376fb0, user_id=77b40a6f00ce4301a3022775c8ade8be, role_id=14df33950256418dae713180ece879af)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.625904 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28565d6d-33e5-4c42-a989-ae6f3a7c0225 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.629254 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650e627-fa63-4dd2-899c-22058df363d6 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.639423 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 790/1556] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 10:13:43 2022] PUT /identity/v3/projects/4fb4a14d03a043a19d11603f33376fb0/users/77b40a6f00ce4301a3022775c8ade8be/roles/14df33950256418dae713180ece879af => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 10:13:43.644409 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54868dee-074d-4e17-9f7c-52ea2c87e9c8 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.644747 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54868dee-074d-4e17-9f7c-52ea2c87e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.645084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54868dee-074d-4e17-9f7c-52ea2c87e9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.662252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-54868dee-074d-4e17-9f7c-52ea2c87e9c8 None None] MFA Rules not processed for user `88fb21474f844e15aceece6e67aa28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:43.663395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-54868dee-074d-4e17-9f7c-52ea2c87e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:43.685273 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650e627-fa63-4dd2-899c-22058df363d6 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.723629 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 791/1557] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:13:43.732598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b358a3-d194-4b84-aefd-820853cd853e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.733281 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b358a3-d194-4b84-aefd-820853cd853e service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.733562 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b358a3-d194-4b84-aefd-820853cd853e service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.733838 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b358a3-d194-4b84-aefd-820853cd853e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.734022 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54868dee-074d-4e17-9f7c-52ea2c87e9c8 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:43.742782 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b358a3-d194-4b84-aefd-820853cd853e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.743220 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54868dee-074d-4e17-9f7c-52ea2c87e9c8 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:43.744219 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b358a3-d194-4b84-aefd-820853cd853e service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.746905 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bcbe3-8e1a-44c2-b7ef-7880c36d27ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:43.747547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bcbe3-8e1a-44c2-b7ef-7880c36d27ac service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:43.747836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bcbe3-8e1a-44c2-b7ef-7880c36d27ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:43.748122 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bcbe3-8e1a-44c2-b7ef-7880c36d27ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:43.753608 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 767/1558] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 10:13:43.757642 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bcbe3-8e1a-44c2-b7ef-7880c36d27ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:43.759113 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bcbe3-8e1a-44c2-b7ef-7880c36d27ac service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:43.769479 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 792/1559] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 10:13:49.934246 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1e30c-1d7b-4a8c-a8f7-7d9357b9a612 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:49.934246 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1e30c-1d7b-4a8c-a8f7-7d9357b9a612 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:49.934246 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1e30c-1d7b-4a8c-a8f7-7d9357b9a612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.000076 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-12d1e30c-1d7b-4a8c-a8f7-7d9357b9a612 None None] MFA Rules not processed for user `77b40a6f00ce4301a3022775c8ade8be`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:50.002932 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-12d1e30c-1d7b-4a8c-a8f7-7d9357b9a612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:50.124173 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 768/1560] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:13:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:13:50.129087 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bcbe3-8e1a-44c2-b7ef-7880c36d27ac service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:50.144359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bcbe3-8e1a-44c2-b7ef-7880c36d27ac service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:50.149332 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509a864-c43e-4a8d-b403-f6fd2ac35ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:50.150224 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509a864-c43e-4a8d-b403-f6fd2ac35ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:50.150467 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509a864-c43e-4a8d-b403-f6fd2ac35ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:50.150608 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509a864-c43e-4a8d-b403-f6fd2ac35ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.151489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509a864-c43e-4a8d-b403-f6fd2ac35ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:50.153665 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509a864-c43e-4a8d-b403-f6fd2ac35ba8 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:50.192337 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 793/1561] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 10:13:50 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:13:50.196208 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1e30c-1d7b-4a8c-a8f7-7d9357b9a612 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:50.210376 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1e30c-1d7b-4a8c-a8f7-7d9357b9a612 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:50.227741 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:50.315885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72432705-6aca-4428-8ef2-f5b245426985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:50.316843 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72432705-6aca-4428-8ef2-f5b245426985 admin admin] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:50.317347 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72432705-6aca-4428-8ef2-f5b245426985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:50.317851 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72432705-6aca-4428-8ef2-f5b245426985 admin admin] PATH_INFO: `/v3/users` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.318884 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72432705-6aca-4428-8ef2-f5b245426985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:50.321207 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72432705-6aca-4428-8ef2-f5b245426985 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:50.359300 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 769/1562] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 10:13:50 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 10:13:50.360860 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e16f0e-05fe-4048-a97b-5467ccd83580 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:50.361196 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e16f0e-05fe-4048-a97b-5467ccd83580 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:50.361554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e16f0e-05fe-4048-a97b-5467ccd83580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.364875 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72432705-6aca-4428-8ef2-f5b245426985 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:50.379170 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72432705-6aca-4428-8ef2-f5b245426985 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:50.390033 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5763c5-8e95-4d98-8668-061beac15dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:50.390866 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5763c5-8e95-4d98-8668-061beac15dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:50.391154 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5763c5-8e95-4d98-8668-061beac15dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:50.391433 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5763c5-8e95-4d98-8668-061beac15dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.392172 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5763c5-8e95-4d98-8668-061beac15dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:50.393901 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5763c5-8e95-4d98-8668-061beac15dfa admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:50.402572 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e8e16f0e-05fe-4048-a97b-5467ccd83580 None None] MFA Rules not processed for user `a83acfc659cc4ba0ac4fb9b009fc2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:50.408757 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e8e16f0e-05fe-4048-a97b-5467ccd83580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:50.417069 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 770/1563] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 10:13:50.424306 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5763c5-8e95-4d98-8668-061beac15dfa admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:50.457585 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5763c5-8e95-4d98-8668-061beac15dfa admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:50.462527 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261b438-3349-4687-aa11-1b88177be1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:50.463422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b438-3349-4687-aa11-1b88177be1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:50.463704 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b438-3349-4687-aa11-1b88177be1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:50.463996 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b438-3349-4687-aa11-1b88177be1d2 admin admin] PATH_INFO: `/v3/projects/2193b57c6c07480eb97f2c37039d6b26/users/941c1412215749bfb4a12031d326a1c0/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.490916 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261b438-3349-4687-aa11-1b88177be1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2193b57c6c07480eb97f2c37039d6b26, user_id=941c1412215749bfb4a12031d326a1c0, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:50.491982 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-3261b438-3349-4687-aa11-1b88177be1d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:13:50.491982 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Jul 05 10:13:50.491982 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: Jul 05 10:13:50.494644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261b438-3349-4687-aa11-1b88177be1d2 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:50.512957 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 771/1564] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 10:13:50 2022] PUT /identity/v3/projects/2193b57c6c07480eb97f2c37039d6b26/users/941c1412215749bfb4a12031d326a1c0/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:13:50.520234 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261b438-3349-4687-aa11-1b88177be1d2 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:50.539626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 794/1565] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:13:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:13:50.544685 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e16f0e-05fe-4048-a97b-5467ccd83580 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:50.565219 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e16f0e-05fe-4048-a97b-5467ccd83580 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:50.612641 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:50.629422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261b438-3349-4687-aa11-1b88177be1d2 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:50.634493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c54fa-821f-4787-bf42-cbb55e53f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:50.635197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c54fa-821f-4787-bf42-cbb55e53f36e admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:50.635477 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c54fa-821f-4787-bf42-cbb55e53f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:50.635770 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c54fa-821f-4787-bf42-cbb55e53f36e admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.636504 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c54fa-821f-4787-bf42-cbb55e53f36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:50.640601 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c54fa-821f-4787-bf42-cbb55e53f36e admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:50.652558 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 772/1566] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:13:50.654486 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199769-a295-412a-8426-e42636b838d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:50.655168 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199769-a295-412a-8426-e42636b838d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:50.655560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199769-a295-412a-8426-e42636b838d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:50.655850 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27199769-a295-412a-8426-e42636b838d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.656557 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27199769-a295-412a-8426-e42636b838d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:50.657128 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c54fa-821f-4787-bf42-cbb55e53f36e admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:50.658543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27199769-a295-412a-8426-e42636b838d2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:50.669531 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c54fa-821f-4787-bf42-cbb55e53f36e admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:50.674958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe6bd-811b-4757-b951-45ecf6f06643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:50.675877 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe6bd-811b-4757-b951-45ecf6f06643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:50.676166 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe6bd-811b-4757-b951-45ecf6f06643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:50.676440 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe6bd-811b-4757-b951-45ecf6f06643 admin admin] PATH_INFO: `/v3/projects/2193b57c6c07480eb97f2c37039d6b26/users/941c1412215749bfb4a12031d326a1c0/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.678856 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fe6bd-811b-4757-b951-45ecf6f06643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2193b57c6c07480eb97f2c37039d6b26, user_id=941c1412215749bfb4a12031d326a1c0, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:50.682110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fe6bd-811b-4757-b951-45ecf6f06643 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:50.688410 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 795/1567] 10.222.0.13 () {60 vars in 1152 bytes} [Tue Jul 5 10:13:50 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:13:50.692783 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199769-a295-412a-8426-e42636b838d2 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:50.698961 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 773/1568] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 10:13:50 2022] PUT /identity/v3/projects/2193b57c6c07480eb97f2c37039d6b26/users/941c1412215749bfb4a12031d326a1c0/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:13:50.765836 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27199769-a295-412a-8426-e42636b838d2 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:50.835300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1df06f-f406-4c28-bb9d-5b6439d17d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:50.836163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1df06f-f406-4c28-bb9d-5b6439d17d11 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:50.836446 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1df06f-f406-4c28-bb9d-5b6439d17d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:50.836729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1df06f-f406-4c28-bb9d-5b6439d17d11 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.837985 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1df06f-f406-4c28-bb9d-5b6439d17d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:50.840084 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1df06f-f406-4c28-bb9d-5b6439d17d11 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:50.863749 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 796/1569] 10.222.0.13 () {60 vars in 1143 bytes} [Tue Jul 5 10:13:50 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 10:13:50.867892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe6bd-811b-4757-b951-45ecf6f06643 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:50.881999 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe6bd-811b-4757-b951-45ecf6f06643 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:50.901469 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19e3cb-c2a7-44f5-990c-30a4a4180c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:50.902312 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19e3cb-c2a7-44f5-990c-30a4a4180c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:50.902739 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19e3cb-c2a7-44f5-990c-30a4a4180c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:50.903113 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19e3cb-c2a7-44f5-990c-30a4a4180c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.903816 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19e3cb-c2a7-44f5-990c-30a4a4180c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:50.905759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19e3cb-c2a7-44f5-990c-30a4a4180c20 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:50.919358 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 774/1570] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 10:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 10:13:50.923466 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1df06f-f406-4c28-bb9d-5b6439d17d11 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:50.954089 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1df06f-f406-4c28-bb9d-5b6439d17d11 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:50.968270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd502d52-5399-4b36-8266-9e7d496a052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:50.969375 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502d52-5399-4b36-8266-9e7d496a052b admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:50.969739 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502d52-5399-4b36-8266-9e7d496a052b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:50.970206 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502d52-5399-4b36-8266-9e7d496a052b admin admin] PATH_INFO: `/v3/projects/1fe015354d854330b520d149602e388d/users/12621840650f4ae4b342acd3eb3dbc0f/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:50.988124 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd502d52-5399-4b36-8266-9e7d496a052b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe015354d854330b520d149602e388d, user_id=12621840650f4ae4b342acd3eb3dbc0f, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:50.995080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd502d52-5399-4b36-8266-9e7d496a052b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:51.012426 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 797/1571] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 10:13:50 2022] PUT /identity/v3/projects/1fe015354d854330b520d149602e388d/users/12621840650f4ae4b342acd3eb3dbc0f/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 10:13:51.016342 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19e3cb-c2a7-44f5-990c-30a4a4180c20 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:51.032862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19e3cb-c2a7-44f5-990c-30a4a4180c20 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:51.117759 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:51.154558 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5977d-c9f7-4b88-a8f7-57c3010e0b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:51.155505 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5977d-c9f7-4b88-a8f7-57c3010e0b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:51.155994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5977d-c9f7-4b88-a8f7-57c3010e0b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:51.156351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5977d-c9f7-4b88-a8f7-57c3010e0b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:51.157198 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5977d-c9f7-4b88-a8f7-57c3010e0b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:51.158912 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5977d-c9f7-4b88-a8f7-57c3010e0b8f admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:51.175199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 775/1572] 10.222.0.13 () {58 vars in 1121 bytes} [Tue Jul 5 10:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 10:13:51.178833 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd502d52-5399-4b36-8266-9e7d496a052b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:51.194135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd502d52-5399-4b36-8266-9e7d496a052b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:51.201729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566b5f0-2d64-4057-bb9a-e5e2d5d87c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:51.202770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566b5f0-2d64-4057-bb9a-e5e2d5d87c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:51.203171 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566b5f0-2d64-4057-bb9a-e5e2d5d87c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:51.203618 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566b5f0-2d64-4057-bb9a-e5e2d5d87c0e admin admin] PATH_INFO: `/v3/projects/1fe015354d854330b520d149602e388d/users/12621840650f4ae4b342acd3eb3dbc0f/roles/4650ad8552cd4c5f96701ea7e3bea401` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:51.205832 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566b5f0-2d64-4057-bb9a-e5e2d5d87c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe015354d854330b520d149602e388d, user_id=12621840650f4ae4b342acd3eb3dbc0f, role_id=4650ad8552cd4c5f96701ea7e3bea401)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:51.208517 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566b5f0-2d64-4057-bb9a-e5e2d5d87c0e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:51.224882 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 798/1573] 10.222.0.13 () {60 vars in 1482 bytes} [Tue Jul 5 10:13:51 2022] PUT /identity/v3/projects/1fe015354d854330b520d149602e388d/users/12621840650f4ae4b342acd3eb3dbc0f/roles/4650ad8552cd4c5f96701ea7e3bea401 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:13:56.387451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f23e6-c4b0-4636-aa74-067405d7f85c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:56.388471 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f23e6-c4b0-4636-aa74-067405d7f85c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:56.389885 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f23e6-c4b0-4636-aa74-067405d7f85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:56.438319 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a15f23e6-c4b0-4636-aa74-067405d7f85c None None] MFA Rules not processed for user `941c1412215749bfb4a12031d326a1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:56.440979 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a15f23e6-c4b0-4636-aa74-067405d7f85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:56.585966 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 776/1574] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:13:56.594089 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566b5f0-2d64-4057-bb9a-e5e2d5d87c0e admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:56.596467 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0566b5f0-2d64-4057-bb9a-e5e2d5d87c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:56.648547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:56.723183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566b5f0-2d64-4057-bb9a-e5e2d5d87c0e admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:56.731736 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61aad1-9d3d-48e9-b496-57f280a6f45b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d1be247c09473ab5f4ac224347a359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:56.732537 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61aad1-9d3d-48e9-b496-57f280a6f45b service glance] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:56.733006 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61aad1-9d3d-48e9-b496-57f280a6f45b service glance] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:56.733876 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61aad1-9d3d-48e9-b496-57f280a6f45b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:56.820112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61aad1-9d3d-48e9-b496-57f280a6f45b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:56.822042 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61aad1-9d3d-48e9-b496-57f280a6f45b service glance] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:56.834894 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 799/1575] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:13:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:13:57.079578 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87b5a4-692f-49af-a1f3-df85cfb20af2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:57.079967 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87b5a4-692f-49af-a1f3-df85cfb20af2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:57.080263 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87b5a4-692f-49af-a1f3-df85cfb20af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:57.107627 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-dc87b5a4-692f-49af-a1f3-df85cfb20af2 None None] MFA Rules not processed for user `f2683e79ea804a7987642df32f03fad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:57.108741 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-dc87b5a4-692f-49af-a1f3-df85cfb20af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:57.223724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 777/1576] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 10:13:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:13:57.409409 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61aad1-9d3d-48e9-b496-57f280a6f45b service glance] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:57.411788 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7a61aad1-9d3d-48e9-b496-57f280a6f45b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:57.452864 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec5bb8-7366-4049-9aaa-7a35ebb03af6 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:57.453383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec5bb8-7366-4049-9aaa-7a35ebb03af6 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:57.453383 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec5bb8-7366-4049-9aaa-7a35ebb03af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:57.485943 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f6ec5bb8-7366-4049-9aaa-7a35ebb03af6 None None] MFA Rules not processed for user `12621840650f4ae4b342acd3eb3dbc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:57.487431 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f6ec5bb8-7366-4049-9aaa-7a35ebb03af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:57.505802 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61aad1-9d3d-48e9-b496-57f280a6f45b service glance] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:57.513812 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765d546-ded7-4856-a37a-ca7cf11002ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1167f58a1ea3465083d67a94043066be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:57.515334 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d546-ded7-4856-a37a-ca7cf11002ac service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:57.515763 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d546-ded7-4856-a37a-ca7cf11002ac service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:57.516597 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d546-ded7-4856-a37a-ca7cf11002ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:57.528008 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765d546-ded7-4856-a37a-ca7cf11002ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:57.530352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765d546-ded7-4856-a37a-ca7cf11002ac service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:57.541488 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 800/1577] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 10:13:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 10:13:57.564051 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:57.600285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 778/1578] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:13:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:13:57.602784 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765d546-ded7-4856-a37a-ca7cf11002ac service swift] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:57.615856 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765d546-ded7-4856-a37a-ca7cf11002ac service swift] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:57.630512 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa2eec-1931-4d8a-a7c4-4db76159bf13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d1be247c09473ab5f4ac224347a359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:57.631245 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa2eec-1931-4d8a-a7c4-4db76159bf13 service glance] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:57.631535 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa2eec-1931-4d8a-a7c4-4db76159bf13 service glance] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:57.633206 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa2eec-1931-4d8a-a7c4-4db76159bf13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:57.740669 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa2eec-1931-4d8a-a7c4-4db76159bf13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:57.742183 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa2eec-1931-4d8a-a7c4-4db76159bf13 service glance] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:57.747901 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:57.755626 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 801/1579] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:13:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:13:59.601476 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bcf08-ece2-4f22-a9a1-ccd2676aa13c None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:59.601968 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bcf08-ece2-4f22-a9a1-ccd2676aa13c None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:59.602072 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bcf08-ece2-4f22-a9a1-ccd2676aa13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:59.629365 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-f33bcf08-ece2-4f22-a9a1-ccd2676aa13c None None] MFA Rules not processed for user `f2683e79ea804a7987642df32f03fad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:13:59.635638 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-f33bcf08-ece2-4f22-a9a1-ccd2676aa13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:13:59.643593 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 779/1580] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 10:13:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:13:59.758735 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa2eec-1931-4d8a-a7c4-4db76159bf13 service glance] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:13:59.778893 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa2eec-1931-4d8a-a7c4-4db76159bf13 service glance] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:13:59.787723 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61c130-a1a7-4540-881e-087efac159ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1167f58a1ea3465083d67a94043066be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:13:59.788984 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61c130-a1a7-4540-881e-087efac159ea service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:13:59.789469 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61c130-a1a7-4540-881e-087efac159ea service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:13:59.789939 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61c130-a1a7-4540-881e-087efac159ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:13:59.813107 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61c130-a1a7-4540-881e-087efac159ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:13:59.814888 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61c130-a1a7-4540-881e-087efac159ea service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:13:59.832300 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 802/1581] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 10:13:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 10:14:08.488199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474b7d0-b47e-47b3-bce4-cd53afac07f7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:08.488743 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474b7d0-b47e-47b3-bce4-cd53afac07f7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:08.488743 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474b7d0-b47e-47b3-bce4-cd53afac07f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:08.505671 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-9474b7d0-b47e-47b3-bce4-cd53afac07f7 None None] MFA Rules not processed for user `77b40a6f00ce4301a3022775c8ade8be`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:08.506867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9474b7d0-b47e-47b3-bce4-cd53afac07f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:08.514520 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 780/1582] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:14:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:14:08.815877 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffc3a5-73f8-4290-96cb-baf8bcdd1e9a None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:08.816395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffc3a5-73f8-4290-96cb-baf8bcdd1e9a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:08.816487 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffc3a5-73f8-4290-96cb-baf8bcdd1e9a None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:08.817862 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 803/1583] 10.222.0.13 () {54 vars in 961 bytes} [Tue Jul 5 10:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:14:08.823888 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5f9ed-df2b-4794-a926-04e95628a386 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:08.824179 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5f9ed-df2b-4794-a926-04e95628a386 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:08.824457 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5f9ed-df2b-4794-a926-04e95628a386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:08.842857 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-00f5f9ed-df2b-4794-a926-04e95628a386 None None] MFA Rules not processed for user `1ff81129f179478d901b590a5be64f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:08.844034 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-00f5f9ed-df2b-4794-a926-04e95628a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:08.909413 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 781/1584] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Jul 5 10:14:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:14:08.915185 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd04f6-883e-4e24-960b-59d2a05d1611 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:08.915528 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd04f6-883e-4e24-960b-59d2a05d1611 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:08.915841 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd04f6-883e-4e24-960b-59d2a05d1611 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:08.917399 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 804/1585] 10.222.0.13 () {54 vars in 912 bytes} [Tue Jul 5 10:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 10:14:08.922342 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdb0c4-899e-41d4-91a3-784df4761bda None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:08.922636 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdb0c4-899e-41d4-91a3-784df4761bda None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:08.922927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdb0c4-899e-41d4-91a3-784df4761bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:08.942066 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-27fdb0c4-899e-41d4-91a3-784df4761bda None None] MFA Rules not processed for user `1ff81129f179478d901b590a5be64f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:08.943277 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-27fdb0c4-899e-41d4-91a3-784df4761bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:08.953547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 782/1586] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 10:14:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:14:08.965379 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd04f6-883e-4e24-960b-59d2a05d1611 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:14:08.967096 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-08bd04f6-883e-4e24-960b-59d2a05d1611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:08.979970 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd04f6-883e-4e24-960b-59d2a05d1611 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:14:08.983547 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f3278-339a-4c45-aa9b-4003d07910d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7d1be247c09473ab5f4ac224347a359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:14:08.984185 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f3278-339a-4c45-aa9b-4003d07910d4 service glance] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:08.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f3278-339a-4c45-aa9b-4003d07910d4 service glance] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:08.984754 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f3278-339a-4c45-aa9b-4003d07910d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:08.995133 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f3278-339a-4c45-aa9b-4003d07910d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:14:08.996560 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f3278-339a-4c45-aa9b-4003d07910d4 service glance] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:14:09.007155 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 805/1587] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:14:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:14:09.353501 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a733a-8f2a-4aa0-9f0a-ffa8b3ff2e6a None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:09.353793 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a733a-8f2a-4aa0-9f0a-ffa8b3ff2e6a None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:09.354070 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a733a-8f2a-4aa0-9f0a-ffa8b3ff2e6a None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:09.355445 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 783/1588] 10.222.0.13 () {54 vars in 912 bytes} [Tue Jul 5 10:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:14:09.360451 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917677-5509-4fe9-94e4-35ba864fd804 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:09.360816 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917677-5509-4fe9-94e4-35ba864fd804 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:09.361184 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917677-5509-4fe9-94e4-35ba864fd804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:09.397567 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-68917677-5509-4fe9-94e4-35ba864fd804 None None] MFA Rules not processed for user `0712574ba8f54b4283c50a74019d315b`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:09.398908 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-68917677-5509-4fe9-94e4-35ba864fd804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:09.449929 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 806/1589] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:14:09.460921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a733a-8f2a-4aa0-9f0a-ffa8b3ff2e6a None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:14:09.485061 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a733a-8f2a-4aa0-9f0a-ffa8b3ff2e6a None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:14:09.489007 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05efead-42d5-454d-b4cb-d72ca6b22cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:14:09.489675 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05efead-42d5-454d-b4cb-d72ca6b22cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:09.489960 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05efead-42d5-454d-b4cb-d72ca6b22cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:09.490240 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05efead-42d5-454d-b4cb-d72ca6b22cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:09.498033 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05efead-42d5-454d-b4cb-d72ca6b22cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:14:09.499631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05efead-42d5-454d-b4cb-d72ca6b22cd1 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:14:09.507800 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 784/1590] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:14:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:14:09.899795 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9baff2-4e37-4df0-aa94-ba8529c0049c None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:09.900371 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9baff2-4e37-4df0-aa94-ba8529c0049c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:09.900598 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9baff2-4e37-4df0-aa94-ba8529c0049c None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:09.902026 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 807/1591] 10.222.0.13 () {54 vars in 961 bytes} [Tue Jul 5 10:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:14:09.909498 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795f6a6-dfb5-4e65-986a-80ff695443b0 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:09.909955 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795f6a6-dfb5-4e65-986a-80ff695443b0 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:09.910340 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795f6a6-dfb5-4e65-986a-80ff695443b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:09.931352 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-6795f6a6-dfb5-4e65-986a-80ff695443b0 None None] MFA Rules not processed for user `1ff81129f179478d901b590a5be64f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:09.932572 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-6795f6a6-dfb5-4e65-986a-80ff695443b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:09.940654 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977bf2-2730-4708-b993-1ff76ba69e5a None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:09.940992 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977bf2-2730-4708-b993-1ff76ba69e5a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:09.941281 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977bf2-2730-4708-b993-1ff76ba69e5a None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:09.942607 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 785/1592] 10.222.0.13 () {58 vars in 1058 bytes} [Tue Jul 5 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:14:09.943105 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 808/1593] 10.222.0.13 () {54 vars in 960 bytes} [Tue Jul 5 10:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:14:09.948514 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d878d-b80c-42df-adce-9c6f77a73b87 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:09.948880 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d878d-b80c-42df-adce-9c6f77a73b87 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:09.949199 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d878d-b80c-42df-adce-9c6f77a73b87 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:09.949311 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21581a-4b28-4a2f-912a-8ad0106e5e2d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:09.949727 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21581a-4b28-4a2f-912a-8ad0106e5e2d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:09.950159 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21581a-4b28-4a2f-912a-8ad0106e5e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:09.950559 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 786/1594] 10.222.0.13 () {54 vars in 912 bytes} [Tue Jul 5 10:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:14:09.955530 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d19472-f1d8-4c49-98c6-7feeb354f0a1 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:09.955898 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d19472-f1d8-4c49-98c6-7feeb354f0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:09.956253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d19472-f1d8-4c49-98c6-7feeb354f0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:09.969759 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5c21581a-4b28-4a2f-912a-8ad0106e5e2d None None] MFA Rules not processed for user `2df8f75ab3ab4468afdd39e7b8e4793f`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:09.971072 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5c21581a-4b28-4a2f-912a-8ad0106e5e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:09.981295 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-04d19472-f1d8-4c49-98c6-7feeb354f0a1 None None] MFA Rules not processed for user `1ff81129f179478d901b590a5be64f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:09.982790 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-04d19472-f1d8-4c49-98c6-7feeb354f0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:10.005644 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 787/1595] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:14:10.011950 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d19472-f1d8-4c49-98c6-7feeb354f0a1 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:14:10.021677 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d19472-f1d8-4c49-98c6-7feeb354f0a1 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:14:10.025736 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04e1f2-0d97-4d9f-b332-f2881b69a8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:14:10.026328 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e1f2-0d97-4d9f-b332-f2881b69a8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:10.026620 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e1f2-0d97-4d9f-b332-f2881b69a8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:10.026897 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e1f2-0d97-4d9f-b332-f2881b69a8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:10.037959 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04e1f2-0d97-4d9f-b332-f2881b69a8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:14:10.039402 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04e1f2-0d97-4d9f-b332-f2881b69a8b8 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:14:10.043574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 809/1596] 10.222.0.13 () {58 vars in 1057 bytes} [Tue Jul 5 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 10:14:10.051338 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21581a-4b28-4a2f-912a-8ad0106e5e2d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:14:10.051995 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 788/1597] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:14:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:14:10.066429 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21581a-4b28-4a2f-912a-8ad0106e5e2d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:14:10.074780 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f453f66-8ea7-4760-9e9c-73704d2fae77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df8f75ab3ab4468afdd39e7b8e4793f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:14:10.076985 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f453f66-8ea7-4760-9e9c-73704d2fae77 service placement] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:10.077584 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f453f66-8ea7-4760-9e9c-73704d2fae77 service placement] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:10.077950 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f453f66-8ea7-4760-9e9c-73704d2fae77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:10.080770 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1f453f66-8ea7-4760-9e9c-73704d2fae77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:10.095870 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f453f66-8ea7-4760-9e9c-73704d2fae77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:14:10.097722 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f453f66-8ea7-4760-9e9c-73704d2fae77 service placement] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:14:10.109204 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 810/1598] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:14:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:14:12.066745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b9dd6-a1a5-4eb2-9951-4244ba044aac None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:12.067215 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b9dd6-a1a5-4eb2-9951-4244ba044aac None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:12.067299 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b9dd6-a1a5-4eb2-9951-4244ba044aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:12.085921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-332b9dd6-a1a5-4eb2-9951-4244ba044aac None None] MFA Rules not processed for user `f2683e79ea804a7987642df32f03fad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:12.087323 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-332b9dd6-a1a5-4eb2-9951-4244ba044aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:12.094846 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 789/1599] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 10:14:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:14:12.107594 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f453f66-8ea7-4760-9e9c-73704d2fae77 service placement] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:14:12.118977 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f453f66-8ea7-4760-9e9c-73704d2fae77 service placement] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:14:12.124437 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e0555-5d7a-4780-a5ef-1c5c2c0788d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1167f58a1ea3465083d67a94043066be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:14:12.125126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0555-5d7a-4780-a5ef-1c5c2c0788d4 service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:12.125418 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0555-5d7a-4780-a5ef-1c5c2c0788d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:12.125729 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0555-5d7a-4780-a5ef-1c5c2c0788d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:12.136747 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e0555-5d7a-4780-a5ef-1c5c2c0788d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:14:12.138373 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e0555-5d7a-4780-a5ef-1c5c2c0788d4 service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:14:12.150778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 811/1600] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 10:14:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 10:14:20.525002 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b412f-7a8e-46b4-9c52-52b4c30e77c2 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:20.525508 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b412f-7a8e-46b4-9c52-52b4c30e77c2 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:20.525596 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b412f-7a8e-46b4-9c52-52b4c30e77c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:20.543670 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a89b412f-7a8e-46b4-9c52-52b4c30e77c2 None None] MFA Rules not processed for user `0712574ba8f54b4283c50a74019d315b`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:20.544867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a89b412f-7a8e-46b4-9c52-52b4c30e77c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:20.551386 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 790/1601] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Jul 5 10:14:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:14:20.566100 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e0555-5d7a-4780-a5ef-1c5c2c0788d4 service swift] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:14:20.575126 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e0555-5d7a-4780-a5ef-1c5c2c0788d4 service swift] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:14:20.578691 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e20984-86db-41b7-b44c-d89c50ad33df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:14:20.579329 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e20984-86db-41b7-b44c-d89c50ad33df service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:20.579614 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e20984-86db-41b7-b44c-d89c50ad33df service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:20.579894 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e20984-86db-41b7-b44c-d89c50ad33df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:20.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e20984-86db-41b7-b44c-d89c50ad33df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:14:20.588179 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e20984-86db-41b7-b44c-d89c50ad33df service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:14:20.595818 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 812/1602] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:14:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:14:21.310503 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a12ee-5041-4a9a-b895-1c81b2b6be07 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:21.311039 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a12ee-5041-4a9a-b895-1c81b2b6be07 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:21.311844 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a12ee-5041-4a9a-b895-1c81b2b6be07 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:21.313883 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 791/1603] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 10:14:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:14:21.325871 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e30fbd-d407-48fb-a454-e2fe765c67d9 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:21.326164 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e30fbd-d407-48fb-a454-e2fe765c67d9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:21.326449 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e30fbd-d407-48fb-a454-e2fe765c67d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:21.364212 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-82e30fbd-d407-48fb-a454-e2fe765c67d9 None None] MFA Rules not processed for user `1ff81129f179478d901b590a5be64f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:21.365534 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-82e30fbd-d407-48fb-a454-e2fe765c67d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:21.378696 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 813/1604] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 10:14:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:14:21.410055 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a12ee-5041-4a9a-b895-1c81b2b6be07 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:14:21.428810 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a12ee-5041-4a9a-b895-1c81b2b6be07 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:14:21.436016 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3f6cb-829c-4f78-a6e8-e7ad4b76bb00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:14:21.437362 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f6cb-829c-4f78-a6e8-e7ad4b76bb00 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:21.437787 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f6cb-829c-4f78-a6e8-e7ad4b76bb00 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:21.438377 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f6cb-829c-4f78-a6e8-e7ad4b76bb00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:21.450699 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3f6cb-829c-4f78-a6e8-e7ad4b76bb00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:14:21.452748 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3f6cb-829c-4f78-a6e8-e7ad4b76bb00 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:14:21.468949 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 792/1605] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:14:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:14:28.143812 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a25b-f42c-4b7e-9ccc-4fbf8f84338b None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:28.144419 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a25b-f42c-4b7e-9ccc-4fbf8f84338b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:28.144511 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a25b-f42c-4b7e-9ccc-4fbf8f84338b None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:28.146125 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 814/1606] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 10:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:14:28.159994 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d0eda-7c5c-4643-8171-701640bf887b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:28.161116 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d0eda-7c5c-4643-8171-701640bf887b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:28.161116 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d0eda-7c5c-4643-8171-701640bf887b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:28.168009 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=74 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:28.181107 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-dd2d0eda-7c5c-4643-8171-701640bf887b None None] MFA Rules not processed for user `1ff81129f179478d901b590a5be64f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:28.182346 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-dd2d0eda-7c5c-4643-8171-701640bf887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:28.191709 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 793/1607] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:14:28.302554 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7a25b-f42c-4b7e-9ccc-4fbf8f84338b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:14:28.311439 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:28.318509 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7a25b-f42c-4b7e-9ccc-4fbf8f84338b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:14:28.324099 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e6e52-5c85-4754-a64d-e5efbc5426bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:14:28.324750 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6e52-5c85-4754-a64d-e5efbc5426bf service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:28.325068 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6e52-5c85-4754-a64d-e5efbc5426bf service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:28.325352 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6e52-5c85-4754-a64d-e5efbc5426bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:28.334317 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e6e52-5c85-4754-a64d-e5efbc5426bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:14:28.335917 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e6e52-5c85-4754-a64d-e5efbc5426bf service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:14:28.346491 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 815/1608] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:14:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:14:38.175785 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:38.342310 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:47.999693 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d0eda-7c5c-4643-8171-701640bf887b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:14:48.009439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d0eda-7c5c-4643-8171-701640bf887b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:14:48.012997 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00464dbd-8a2f-48bd-8cb2-24fd2c6e7dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:14:48.013633 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00464dbd-8a2f-48bd-8cb2-24fd2c6e7dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:48.013915 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00464dbd-8a2f-48bd-8cb2-24fd2c6e7dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:48.014189 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00464dbd-8a2f-48bd-8cb2-24fd2c6e7dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:48.023043 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00464dbd-8a2f-48bd-8cb2-24fd2c6e7dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:14:48.025112 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00464dbd-8a2f-48bd-8cb2-24fd2c6e7dc1 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:14:48.034339 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 794/1609] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:14:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:14:53.238040 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c4b8-82d7-4357-837e-3324ea4d6611 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:14:53.238555 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c4b8-82d7-4357-837e-3324ea4d6611 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:14:53.238674 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c4b8-82d7-4357-837e-3324ea4d6611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:14:53.256284 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0864c4b8-82d7-4357-837e-3324ea4d6611 None None] MFA Rules not processed for user `a83acfc659cc4ba0ac4fb9b009fc2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:14:53.257524 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0864c4b8-82d7-4357-837e-3324ea4d6611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:14:53.264789 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 816/1610] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:14:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:14:58.030231 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=6 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:15:03.250276 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:15:33.402892 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29f24-3eca-4096-8431-84d33d6e3159 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:15:33.403412 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29f24-3eca-4096-8431-84d33d6e3159 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:15:33.403497 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29f24-3eca-4096-8431-84d33d6e3159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:15:33.420393 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-b3a29f24-3eca-4096-8431-84d33d6e3159 None None] MFA Rules not processed for user `a83acfc659cc4ba0ac4fb9b009fc2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:15:33.421631 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-b3a29f24-3eca-4096-8431-84d33d6e3159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:15:33.428483 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 795/1611] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:15:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:15:43.415448 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:15:50.370577 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024efcc5-b001-4c98-aad7-bc6908f4817a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:15:50.371081 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024efcc5-b001-4c98-aad7-bc6908f4817a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:15:50.371162 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024efcc5-b001-4c98-aad7-bc6908f4817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:15:50.388732 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-024efcc5-b001-4c98-aad7-bc6908f4817a None None] MFA Rules not processed for user `f2683e79ea804a7987642df32f03fad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:15:50.389951 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-024efcc5-b001-4c98-aad7-bc6908f4817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:15:50.396977 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 817/1612] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:15:50.437690 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a29f24-3eca-4096-8431-84d33d6e3159 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:15:50.449225 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a29f24-3eca-4096-8431-84d33d6e3159 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:15:50.454089 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fd5db-7690-43f6-82e0-66fc4ac307c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1167f58a1ea3465083d67a94043066be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:15:50.454748 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fd5db-7690-43f6-82e0-66fc4ac307c7 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:15:50.455032 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fd5db-7690-43f6-82e0-66fc4ac307c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:15:50.455305 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fd5db-7690-43f6-82e0-66fc4ac307c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:15:50.463013 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fd5db-7690-43f6-82e0-66fc4ac307c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:15:50.464636 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fd5db-7690-43f6-82e0-66fc4ac307c7 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:15:50.472873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 796/1613] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 10:15:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 10:15:53.782093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d31e8-c65d-4c14-a501-af5f35e9100e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:15:53.782577 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d31e8-c65d-4c14-a501-af5f35e9100e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:15:53.782664 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d31e8-c65d-4c14-a501-af5f35e9100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:15:53.800012 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d35d31e8-c65d-4c14-a501-af5f35e9100e None None] MFA Rules not processed for user `a83acfc659cc4ba0ac4fb9b009fc2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:15:53.801211 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d35d31e8-c65d-4c14-a501-af5f35e9100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:15:53.808204 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 818/1614] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:15:54.071451 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a45bb9-2fe5-41d8-8051-9d36b8b014d7 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:15:54.071927 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a45bb9-2fe5-41d8-8051-9d36b8b014d7 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:15:54.072018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a45bb9-2fe5-41d8-8051-9d36b8b014d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:15:54.090868 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-d8a45bb9-2fe5-41d8-8051-9d36b8b014d7 None None] MFA Rules not processed for user `0712574ba8f54b4283c50a74019d315b`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:15:54.092162 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-d8a45bb9-2fe5-41d8-8051-9d36b8b014d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:15:54.099057 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 797/1615] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 10:15:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:15:54.110450 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d31e8-c65d-4c14-a501-af5f35e9100e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:15:54.119995 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d31e8-c65d-4c14-a501-af5f35e9100e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:15:54.123522 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde5af2-d545-48c8-b441-5c24469a336e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:15:54.124160 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde5af2-d545-48c8-b441-5c24469a336e service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:15:54.124448 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde5af2-d545-48c8-b441-5c24469a336e service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:15:54.124723 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde5af2-d545-48c8-b441-5c24469a336e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:15:54.132207 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde5af2-d545-48c8-b441-5c24469a336e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:15:54.133659 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde5af2-d545-48c8-b441-5c24469a336e service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:15:54.141286 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 819/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:15:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:16:04.086012 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=9 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:04.137941 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=12 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:22.325724 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b3bfd-a0c9-4807-8b2c-6fdc0bc6ce11 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:16:22.326243 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b3bfd-a0c9-4807-8b2c-6fdc0bc6ce11 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:16:22.326432 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b3bfd-a0c9-4807-8b2c-6fdc0bc6ce11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:16:22.345470 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-a23b3bfd-a0c9-4807-8b2c-6fdc0bc6ce11 None None] MFA Rules not processed for user `f2683e79ea804a7987642df32f03fad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:16:22.346673 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a23b3bfd-a0c9-4807-8b2c-6fdc0bc6ce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:16:22.354415 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 798/1617] 10.222.0.13 () {58 vars in 967 bytes} [Tue Jul 5 10:16:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:16:22.368189 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde5af2-d545-48c8-b441-5c24469a336e service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:16:22.388734 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde5af2-d545-48c8-b441-5c24469a336e service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:16:22.394153 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6af3-0241-46d5-9775-64cbaea88fe1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1167f58a1ea3465083d67a94043066be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:16:22.394821 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6af3-0241-46d5-9775-64cbaea88fe1 service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:16:22.395110 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6af3-0241-46d5-9775-64cbaea88fe1 service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:16:22.395745 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6af3-0241-46d5-9775-64cbaea88fe1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:16:22.405146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c6af3-0241-46d5-9775-64cbaea88fe1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:16:22.406772 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c6af3-0241-46d5-9775-64cbaea88fe1 service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:16:22.416462 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 820/1618] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 10:16:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 10:16:32.340349 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:32.412213 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=6 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:38.897493 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa1c96-f0fb-45be-966d-3a27d2d3f95d None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:16:38.897961 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa1c96-f0fb-45be-966d-3a27d2d3f95d None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:16:38.898119 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa1c96-f0fb-45be-966d-3a27d2d3f95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:16:38.915485 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-57fa1c96-f0fb-45be-966d-3a27d2d3f95d None None] MFA Rules not processed for user `a83acfc659cc4ba0ac4fb9b009fc2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:16:38.916697 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-57fa1c96-f0fb-45be-966d-3a27d2d3f95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:16:38.923718 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 799/1619] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:16:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:16:48.910041 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:55.139779 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6af3-0241-46d5-9775-64cbaea88fe1 service swift] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:16:55.148807 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6af3-0241-46d5-9775-64cbaea88fe1 service swift] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:16:55.152382 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d0e24-a66f-4da2-ad91-92f737e3dc05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:16:55.153057 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d0e24-a66f-4da2-ad91-92f737e3dc05 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:16:55.153341 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d0e24-a66f-4da2-ad91-92f737e3dc05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:16:55.153619 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d0e24-a66f-4da2-ad91-92f737e3dc05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:16:55.162355 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d0e24-a66f-4da2-ad91-92f737e3dc05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:16:55.163798 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d0e24-a66f-4da2-ad91-92f737e3dc05 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:16:55.173329 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 821/1620] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:16:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:17:05.169045 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=6 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:00.877682 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa1c96-f0fb-45be-966d-3a27d2d3f95d None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:18:00.938461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa1c96-f0fb-45be-966d-3a27d2d3f95d None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:18:00.943558 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca062817-7d43-4223-9e86-ed4dcad2c453 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df8f75ab3ab4468afdd39e7b8e4793f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:18:00.944211 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca062817-7d43-4223-9e86-ed4dcad2c453 service placement] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:00.944519 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca062817-7d43-4223-9e86-ed4dcad2c453 service placement] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:00.944791 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca062817-7d43-4223-9e86-ed4dcad2c453 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:00.953577 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca062817-7d43-4223-9e86-ed4dcad2c453 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:18:00.955230 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca062817-7d43-4223-9e86-ed4dcad2c453 service placement] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:18:00.965353 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 800/1621] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:18:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:18:02.058600 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313e6fa-a30e-4dfd-a99b-eeebde3f464e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:02.059066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313e6fa-a30e-4dfd-a99b-eeebde3f464e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:02.059156 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313e6fa-a30e-4dfd-a99b-eeebde3f464e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:02.126378 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1313e6fa-a30e-4dfd-a99b-eeebde3f464e None None] MFA Rules not processed for user `f2683e79ea804a7987642df32f03fad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:18:02.127507 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1313e6fa-a30e-4dfd-a99b-eeebde3f464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:18:02.152022 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 822/1622] 10.222.0.13 () {58 vars in 967 bytes} [Tue Jul 5 10:18:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:18:02.196104 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca062817-7d43-4223-9e86-ed4dcad2c453 service placement] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:18:02.217628 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca062817-7d43-4223-9e86-ed4dcad2c453 service placement] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:18:02.222710 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0f9da-844f-4882-8c52-616c36f991a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1167f58a1ea3465083d67a94043066be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:18:02.223351 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f9da-844f-4882-8c52-616c36f991a9 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:02.223639 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f9da-844f-4882-8c52-616c36f991a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:02.223921 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f9da-844f-4882-8c52-616c36f991a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:02.231958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0f9da-844f-4882-8c52-616c36f991a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:18:02.233598 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0f9da-844f-4882-8c52-616c36f991a9 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:18:02.241546 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 801/1623] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 10:18:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 10:18:02.684508 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e844af8-362b-48de-915f-eb948390b3cf None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:02.684801 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e844af8-362b-48de-915f-eb948390b3cf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:02.685113 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e844af8-362b-48de-915f-eb948390b3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:02.702135 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5e844af8-362b-48de-915f-eb948390b3cf None None] MFA Rules not processed for user `f2683e79ea804a7987642df32f03fad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:18:02.703303 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5e844af8-362b-48de-915f-eb948390b3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:18:02.712150 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 823/1624] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 10:18:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:18:02.725947 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0f9da-844f-4882-8c52-616c36f991a9 service swift] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:18:02.736212 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0f9da-844f-4882-8c52-616c36f991a9 service swift] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:18:02.741401 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb418c1e-a618-4249-b40d-bcb890f61b04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1167f58a1ea3465083d67a94043066be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:18:02.742539 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb418c1e-a618-4249-b40d-bcb890f61b04 service swift] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:02.742825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb418c1e-a618-4249-b40d-bcb890f61b04 service swift] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:02.743108 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb418c1e-a618-4249-b40d-bcb890f61b04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:02.751058 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb418c1e-a618-4249-b40d-bcb890f61b04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:18:02.752680 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb418c1e-a618-4249-b40d-bcb890f61b04 service swift] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:18:02.761256 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 802/1625] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 10:18:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 10:18:10.898984 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da11769-edc2-44d1-a024-ae01bdf0a167 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:10.899490 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da11769-edc2-44d1-a024-ae01bdf0a167 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:10.899598 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da11769-edc2-44d1-a024-ae01bdf0a167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:10.916777 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5da11769-edc2-44d1-a024-ae01bdf0a167 None None] MFA Rules not processed for user `77b40a6f00ce4301a3022775c8ade8be`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:18:10.917982 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5da11769-edc2-44d1-a024-ae01bdf0a167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:18:10.924693 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 824/1626] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:18:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:18:12.691645 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd83a1-5b5c-4a49-bd6f-fbc8e5c31a00 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:12.692226 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd83a1-5b5c-4a49-bd6f-fbc8e5c31a00 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:12.692316 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd83a1-5b5c-4a49-bd6f-fbc8e5c31a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:12.712272 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-adfd83a1-5b5c-4a49-bd6f-fbc8e5c31a00 None None] MFA Rules not processed for user `f2683e79ea804a7987642df32f03fad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:18:12.713639 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-adfd83a1-5b5c-4a49-bd6f-fbc8e5c31a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:18:12.721459 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 803/1627] 10.222.0.13 () {58 vars in 1009 bytes} [Tue Jul 5 10:18:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:18:12.735544 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da11769-edc2-44d1-a024-ae01bdf0a167 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:18:12.748231 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da11769-edc2-44d1-a024-ae01bdf0a167 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:18:12.753256 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e625b-d7a4-40ba-904d-67621a11dcf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1167f58a1ea3465083d67a94043066be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:18:12.753962 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e625b-d7a4-40ba-904d-67621a11dcf2 service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:12.754246 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e625b-d7a4-40ba-904d-67621a11dcf2 service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:12.754531 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e625b-d7a4-40ba-904d-67621a11dcf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:12.763422 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e625b-d7a4-40ba-904d-67621a11dcf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:18:12.765307 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e625b-d7a4-40ba-904d-67621a11dcf2 service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:18:12.774380 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 825/1628] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 10:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 10:18:22.706356 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=46 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:22.770718 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=41 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:42.208929 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e008eb6-b988-400b-8520-87876e73c021 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:42.210130 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e008eb6-b988-400b-8520-87876e73c021 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:42.210480 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e008eb6-b988-400b-8520-87876e73c021 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:42.213242 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 804/1629] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 10:18:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:18:42.223457 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7b775-8468-48eb-835d-bea7e168ea3a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:42.224877 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7b775-8468-48eb-835d-bea7e168ea3a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:42.225359 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7b775-8468-48eb-835d-bea7e168ea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:42.310805 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-29a7b775-8468-48eb-835d-bea7e168ea3a None None] MFA Rules not processed for user `1ff81129f179478d901b590a5be64f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:18:42.312052 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-29a7b775-8468-48eb-835d-bea7e168ea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:18:42.337127 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 826/1630] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 10:18:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:18:42.353478 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e008eb6-b988-400b-8520-87876e73c021 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:18:42.370874 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e008eb6-b988-400b-8520-87876e73c021 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:18:42.379867 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ab7e8-fdee-46e5-bcb5-772bb1c7dc60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:18:42.380705 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ab7e8-fdee-46e5-bcb5-772bb1c7dc60 service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:42.381148 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ab7e8-fdee-46e5-bcb5-772bb1c7dc60 service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:42.381529 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ab7e8-fdee-46e5-bcb5-772bb1c7dc60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:42.393716 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ab7e8-fdee-46e5-bcb5-772bb1c7dc60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:18:42.395615 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ab7e8-fdee-46e5-bcb5-772bb1c7dc60 service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:18:42.408667 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 805/1631] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:18:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 10:18:52.333093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=22 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:52.403825 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=6 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:57.649954 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7b775-8468-48eb-835d-bea7e168ea3a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:18:57.660723 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7b775-8468-48eb-835d-bea7e168ea3a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:18:57.667403 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a50c3-26e2-439e-bc25-c09791518044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:18:57.668054 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a50c3-26e2-439e-bc25-c09791518044 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:57.668369 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a50c3-26e2-439e-bc25-c09791518044 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:57.668652 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a50c3-26e2-439e-bc25-c09791518044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:57.676478 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a50c3-26e2-439e-bc25-c09791518044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:18:57.678114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a50c3-26e2-439e-bc25-c09791518044 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:18:57.687328 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 827/1632] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:18:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:18:57.728619 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb55167-c7c2-496e-b4e9-9a15db4594ce None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:18:57.729202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb55167-c7c2-496e-b4e9-9a15db4594ce None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:18:57.729202 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb55167-c7c2-496e-b4e9-9a15db4594ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:18:57.746591 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-1bb55167-c7c2-496e-b4e9-9a15db4594ce None None] MFA Rules not processed for user `a83acfc659cc4ba0ac4fb9b009fc2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:18:57.747780 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1bb55167-c7c2-496e-b4e9-9a15db4594ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:18:57.754754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 806/1633] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:18:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:19:06.676093 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a50c3-26e2-439e-bc25-c09791518044 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:19:06.687024 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a50c3-26e2-439e-bc25-c09791518044 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:19:06.692386 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624e8ed-6be6-46b1-9c68-5a90946ab509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:19:06.693050 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624e8ed-6be6-46b1-9c68-5a90946ab509 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:19:06.693365 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624e8ed-6be6-46b1-9c68-5a90946ab509 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:19:06.693639 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624e8ed-6be6-46b1-9c68-5a90946ab509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:19:06.701634 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624e8ed-6be6-46b1-9c68-5a90946ab509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:19:06.703190 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624e8ed-6be6-46b1-9c68-5a90946ab509 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:19:06.712380 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 828/1634] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:19:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:19:07.741552 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=3 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:09.303137 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb55167-c7c2-496e-b4e9-9a15db4594ce None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:19:09.322873 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb55167-c7c2-496e-b4e9-9a15db4594ce None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:19:09.326641 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f673cac-d3bd-420c-bc33-c870961bb72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:19:09.327294 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f673cac-d3bd-420c-bc33-c870961bb72c service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:19:09.327582 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f673cac-d3bd-420c-bc33-c870961bb72c service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:19:09.327863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f673cac-d3bd-420c-bc33-c870961bb72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:19:09.339224 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f673cac-d3bd-420c-bc33-c870961bb72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:19:09.340619 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f673cac-d3bd-420c-bc33-c870961bb72c service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:19:09.352018 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 807/1635] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:19:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:19:10.417755 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624e8ed-6be6-46b1-9c68-5a90946ab509 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:19:10.426820 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624e8ed-6be6-46b1-9c68-5a90946ab509 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:19:10.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d0c61-35e6-4ba5-90da-9d6e122cdf7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:19:10.431511 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d0c61-35e6-4ba5-90da-9d6e122cdf7e service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:19:10.431792 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d0c61-35e6-4ba5-90da-9d6e122cdf7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:19:10.432095 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d0c61-35e6-4ba5-90da-9d6e122cdf7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:19:10.442296 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d0c61-35e6-4ba5-90da-9d6e122cdf7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:19:10.443778 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d0c61-35e6-4ba5-90da-9d6e122cdf7e service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:19:10.454499 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 829/1636] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:19:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:19:19.346683 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=10 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:20.449924 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=18 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:58.223732 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f673cac-d3bd-420c-bc33-c870961bb72c service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:19:58.237473 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f673cac-d3bd-420c-bc33-c870961bb72c service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:19:58.244442 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11761c6a-f8d6-420f-94e4-30b39ca16f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:19:58.245197 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761c6a-f8d6-420f-94e4-30b39ca16f2a service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:19:58.245435 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761c6a-f8d6-420f-94e4-30b39ca16f2a service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:19:58.245720 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761c6a-f8d6-420f-94e4-30b39ca16f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:19:58.255973 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11761c6a-f8d6-420f-94e4-30b39ca16f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:19:58.257773 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11761c6a-f8d6-420f-94e4-30b39ca16f2a service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:19:58.270971 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 808/1637] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:19:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:19:58.376357 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d0c61-35e6-4ba5-90da-9d6e122cdf7e service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:19:58.386946 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d0c61-35e6-4ba5-90da-9d6e122cdf7e service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:19:58.393744 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b74f1-d0a9-42ff-a392-008caf2d79b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:19:58.394875 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b74f1-d0a9-42ff-a392-008caf2d79b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:19:58.395355 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b74f1-d0a9-42ff-a392-008caf2d79b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:19:58.395711 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b74f1-d0a9-42ff-a392-008caf2d79b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:19:58.406395 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b74f1-d0a9-42ff-a392-008caf2d79b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:19:58.408066 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b74f1-d0a9-42ff-a392-008caf2d79b7 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:19:58.441097 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 830/1638] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:19:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:20:05.955345 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f737de-0b44-44e6-8eab-4639994ca62b None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:05.955815 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f737de-0b44-44e6-8eab-4639994ca62b None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:05.955911 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f737de-0b44-44e6-8eab-4639994ca62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:05.973236 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-73f737de-0b44-44e6-8eab-4639994ca62b None None] MFA Rules not processed for user `f2683e79ea804a7987642df32f03fad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:20:05.974439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-73f737de-0b44-44e6-8eab-4639994ca62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:20:05.982040 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 809/1639] 10.222.0.13 () {58 vars in 967 bytes} [Tue Jul 5 10:20:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:20:06.024201 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b74f1-d0a9-42ff-a392-008caf2d79b7 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:20:06.036458 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b74f1-d0a9-42ff-a392-008caf2d79b7 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:20:06.041558 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61093bc8-e7b5-479d-b204-2d32ef7346e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1167f58a1ea3465083d67a94043066be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:20:06.042203 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093bc8-e7b5-479d-b204-2d32ef7346e4 service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:06.042489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093bc8-e7b5-479d-b204-2d32ef7346e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:06.042766 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61093bc8-e7b5-479d-b204-2d32ef7346e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:06.050762 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61093bc8-e7b5-479d-b204-2d32ef7346e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:20:06.052336 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61093bc8-e7b5-479d-b204-2d32ef7346e4 service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:20:06.061286 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 831/1640] 10.222.0.13 () {60 vars in 1384 bytes} [Tue Jul 5 10:20:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 10:20:06.429541 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f737de-0b44-44e6-8eab-4639994ca62b None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:20:06.430944 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-73f737de-0b44-44e6-8eab-4639994ca62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:20:06.454821 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f737de-0b44-44e6-8eab-4639994ca62b None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:20:06.458355 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab162867-ecfa-4281-8541-d4c09c41df52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:20:06.458995 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab162867-ecfa-4281-8541-d4c09c41df52 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:06.459280 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab162867-ecfa-4281-8541-d4c09c41df52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:06.459560 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab162867-ecfa-4281-8541-d4c09c41df52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:06.527037 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab162867-ecfa-4281-8541-d4c09c41df52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:20:06.528503 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab162867-ecfa-4281-8541-d4c09c41df52 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:20:06.546584 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 810/1641] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:20:09.749252 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9c531-ff91-40d9-9750-1a9a19043d43 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:09.749721 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9c531-ff91-40d9-9750-1a9a19043d43 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:09.749817 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9c531-ff91-40d9-9750-1a9a19043d43 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:09.751254 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 832/1642] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 10:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:20:09.761275 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4869f9-f175-47f1-8062-8fde9bca56f4 None None] REQUEST_METHOD: `POST` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:09.761703 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4869f9-f175-47f1-8062-8fde9bca56f4 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:09.762006 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4869f9-f175-47f1-8062-8fde9bca56f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:09.826500 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.auth.core [None req-df4869f9-f175-47f1-8062-8fde9bca56f4 None None] MFA Rules not processed for user `2df8f75ab3ab4468afdd39e7b8e4793f`. Rule list: `[]` (Enabled: `True`). {{(pid=80360) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:20:09.827551 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-df4869f9-f175-47f1-8062-8fde9bca56f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:20:09.840456 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 811/1643] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 10:20:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:20:09.851018 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9c531-ff91-40d9-9750-1a9a19043d43 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:20:09.864483 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9c531-ff91-40d9-9750-1a9a19043d43 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:20:09.870055 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ff7fe-0d76-45d4-8cd3-ee28a8f0f727 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df8f75ab3ab4468afdd39e7b8e4793f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:20:09.870700 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff7fe-0d76-45d4-8cd3-ee28a8f0f727 service placement] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:09.870990 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff7fe-0d76-45d4-8cd3-ee28a8f0f727 service placement] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:09.871270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff7fe-0d76-45d4-8cd3-ee28a8f0f727 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:09.879856 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ff7fe-0d76-45d4-8cd3-ee28a8f0f727 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:20:09.881508 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ff7fe-0d76-45d4-8cd3-ee28a8f0f727 service placement] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:20:09.893571 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 833/1644] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:20:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:20:12.916754 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fb65c-dd08-4560-a8cc-75b7585f3b08 None None] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:12.917240 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fb65c-dd08-4560-a8cc-75b7585f3b08 None None] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:12.917343 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fb65c-dd08-4560-a8cc-75b7585f3b08 None None] PATH_INFO: `/` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:12.918732 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 812/1645] 10.222.0.13 () {54 vars in 921 bytes} [Tue Jul 5 10:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 10:20:12.933265 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a02b9-f2c5-41d4-a3dc-c1ffe17c7883 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:12.933689 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a02b9-f2c5-41d4-a3dc-c1ffe17c7883 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:12.933842 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a02b9-f2c5-41d4-a3dc-c1ffe17c7883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:12.951761 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ba5a02b9-f2c5-41d4-a3dc-c1ffe17c7883 None None] MFA Rules not processed for user `2df8f75ab3ab4468afdd39e7b8e4793f`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:20:12.953147 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ba5a02b9-f2c5-41d4-a3dc-c1ffe17c7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:20:12.962080 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 834/1646] 10.222.0.13 () {58 vars in 1018 bytes} [Tue Jul 5 10:20:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:20:12.980555 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fb65c-dd08-4560-a8cc-75b7585f3b08 None None] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:20:12.996701 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fb65c-dd08-4560-a8cc-75b7585f3b08 None None] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:20:12.996939 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a02b9-f2c5-41d4-a3dc-c1ffe17c7883 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:20:13.002352 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee65a-c560-4a8c-bd3d-b40e5d30f5d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df8f75ab3ab4468afdd39e7b8e4793f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:20:13.003008 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee65a-c560-4a8c-bd3d-b40e5d30f5d1 service placement] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:13.003302 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee65a-c560-4a8c-bd3d-b40e5d30f5d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:13.003585 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee65a-c560-4a8c-bd3d-b40e5d30f5d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:13.011146 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a02b9-f2c5-41d4-a3dc-c1ffe17c7883 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:20:13.014313 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee65a-c560-4a8c-bd3d-b40e5d30f5d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:20:13.015746 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:20:13.015947 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee65a-c560-4a8c-bd3d-b40e5d30f5d1 service placement] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:20:13.016622 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:13.016923 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:13.017202 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] PATH_INFO: `/v3/users/77b40a6f00ce4301a3022775c8ade8be` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:13.018397 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b40a6f00ce4301a3022775c8ade8be)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:20:13.020298 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:20:13.026368 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 813/1647] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:20:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:20:13.071715 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b40a6f00ce4301a3022775c8ade8be'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.083963 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b40a6f00ce4301a3022775c8ade8be'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.091476 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b40a6f00ce4301a3022775c8ade8be'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.092163 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b40a6f00ce4301a3022775c8ade8be'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.092785 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b40a6f00ce4301a3022775c8ade8be'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.105442 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 835/1648] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 10:20:12 2022] DELETE /identity/v3/users/77b40a6f00ce4301a3022775c8ade8be => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 10:20:13.282695 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee65a-c560-4a8c-bd3d-b40e5d30f5d1 service placement] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:20:13.301537 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee65a-c560-4a8c-bd3d-b40e5d30f5d1 service placement] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:20:13.359064 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:20:13.360000 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:13.360283 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:13.360561 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] PATH_INFO: `/v3/projects/4fb4a14d03a043a19d11603f33376fb0` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:13.361798 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb4a14d03a043a19d11603f33376fb0)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:20:13.363719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:20:13.365928 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=100 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:13.411597 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb4a14d03a043a19d11603f33376fb0', 'request_id': 'req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.418404 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb4a14d03a043a19d11603f33376fb0', 'request_id': 'req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.424621 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb4a14d03a043a19d11603f33376fb0', 'request_id': 'req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.447304 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] The token cache is being invalidate because project 4fb4a14d03a043a19d11603f33376fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 10:20:13.448194 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.448838 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.450405 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 814/1649] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 10:20:13 2022] DELETE /identity/v3/projects/4fb4a14d03a043a19d11603f33376fb0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:20:13.454460 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:20:13.455793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:20:13.468518 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31e7cf-ad14-48a6-ac33-3bc1919a3e46 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:20:13.524441 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812b010-666c-441b-9d38-a609dd1f92fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:20:13.525415 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812b010-666c-441b-9d38-a609dd1f92fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:13.525701 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812b010-666c-441b-9d38-a609dd1f92fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:13.525977 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812b010-666c-441b-9d38-a609dd1f92fa admin admin] PATH_INFO: `/v3/users/941c1412215749bfb4a12031d326a1c0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:13.527160 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812b010-666c-441b-9d38-a609dd1f92fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=941c1412215749bfb4a12031d326a1c0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:20:13.529112 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812b010-666c-441b-9d38-a609dd1f92fa admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:20:13.556425 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:13.575497 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2812b010-666c-441b-9d38-a609dd1f92fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941c1412215749bfb4a12031d326a1c0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.587462 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2812b010-666c-441b-9d38-a609dd1f92fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941c1412215749bfb4a12031d326a1c0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.594511 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2812b010-666c-441b-9d38-a609dd1f92fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941c1412215749bfb4a12031d326a1c0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.595193 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2812b010-666c-441b-9d38-a609dd1f92fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941c1412215749bfb4a12031d326a1c0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.595799 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2812b010-666c-441b-9d38-a609dd1f92fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941c1412215749bfb4a12031d326a1c0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.608238 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 836/1650] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 10:20:13 2022] DELETE /identity/v3/users/941c1412215749bfb4a12031d326a1c0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:20:13.786167 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:20:13.788010 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:20:13.804789 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ebf63-f7b4-4252-b4e3-3c79fbb2386d admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:20:13.863101 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:20:13.864297 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:13.864575 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:13.864851 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] PATH_INFO: `/v3/projects/2193b57c6c07480eb97f2c37039d6b26` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:13.866050 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2193b57c6c07480eb97f2c37039d6b26)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:20:13.868269 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:20:13.916882 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2193b57c6c07480eb97f2c37039d6b26', 'request_id': 'req-084a9869-43ac-4d3f-ad41-53116df0da46'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.923745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2193b57c6c07480eb97f2c37039d6b26', 'request_id': 'req-084a9869-43ac-4d3f-ad41-53116df0da46'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.929745 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2193b57c6c07480eb97f2c37039d6b26', 'request_id': 'req-084a9869-43ac-4d3f-ad41-53116df0da46'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.940566 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] The token cache is being invalidate because project 2193b57c6c07480eb97f2c37039d6b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80360) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 10:20:13.940851 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.941502 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:20:13.943031 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 815/1651] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 10:20:13 2022] DELETE /identity/v3/projects/2193b57c6c07480eb97f2c37039d6b26 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:20:23.605249 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=19,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:23.937623 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=79,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:49.106268 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccad7f-5321-46cd-8d01-95a00ea19283 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:49.106746 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccad7f-5321-46cd-8d01-95a00ea19283 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:49.106843 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccad7f-5321-46cd-8d01-95a00ea19283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:49.125266 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a4ccad7f-5321-46cd-8d01-95a00ea19283 None None] MFA Rules not processed for user `a83acfc659cc4ba0ac4fb9b009fc2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 10:20:49.126465 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a4ccad7f-5321-46cd-8d01-95a00ea19283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:20:49.179439 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 837/1652] 10.222.0.13 () {58 vars in 957 bytes} [Tue Jul 5 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 10:20:49.490553 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:20:49.491964 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:20:49.548886 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a9869-43ac-4d3f-ad41-53116df0da46 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:20:49.552489 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a1d3b-4bcc-4fbc-a9e9-fb4ee1927995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:20:49.553169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a1d3b-4bcc-4fbc-a9e9-fb4ee1927995 service neutron] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:49.553459 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a1d3b-4bcc-4fbc-a9e9-fb4ee1927995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:49.553741 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a1d3b-4bcc-4fbc-a9e9-fb4ee1927995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:49.555521 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-416a1d3b-4bcc-4fbc-a9e9-fb4ee1927995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:20:49.565422 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a1d3b-4bcc-4fbc-a9e9-fb4ee1927995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:20:49.566863 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a1d3b-4bcc-4fbc-a9e9-fb4ee1927995 service neutron] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:20:49.575144 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 816/1653] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:20:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:20:50.001283 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccad7f-5321-46cd-8d01-95a00ea19283 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:20:50.002633 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a4ccad7f-5321-46cd-8d01-95a00ea19283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:20:50.072114 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccad7f-5321-46cd-8d01-95a00ea19283 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:20:50.077550 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7bd2b-b045-4d03-9ce5-35e0e4939798 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df8f75ab3ab4468afdd39e7b8e4793f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:20:50.078202 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7bd2b-b045-4d03-9ce5-35e0e4939798 service placement] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:20:50.078484 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7bd2b-b045-4d03-9ce5-35e0e4939798 service placement] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:20:50.078761 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7bd2b-b045-4d03-9ce5-35e0e4939798 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:20:50.080574 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8cc7bd2b-b045-4d03-9ce5-35e0e4939798 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:20:50.092099 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7bd2b-b045-4d03-9ce5-35e0e4939798 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:20:50.093792 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7bd2b-b045-4d03-9ce5-35e0e4939798 service placement] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:20:50.103335 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 838/1654] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:20:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:20:59.571181 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=26 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:00.099321 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=57 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:02.222169 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a1d3b-4bcc-4fbc-a9e9-fb4ee1927995 service neutron] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:21:02.223638 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-416a1d3b-4bcc-4fbc-a9e9-fb4ee1927995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:21:02.298613 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a1d3b-4bcc-4fbc-a9e9-fb4ee1927995 service neutron] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:21:02.304065 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a1e5-b2e9-4f37-9976-de4e1af455bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ff81129f179478d901b590a5be64f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:21:02.304656 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a1e5-b2e9-4f37-9976-de4e1af455bd service nova] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:21:02.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a1e5-b2e9-4f37-9976-de4e1af455bd service nova] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:21:02.305250 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a1e5-b2e9-4f37-9976-de4e1af455bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:21:02.307041 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9d23a1e5-b2e9-4f37-9976-de4e1af455bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:21:02.319388 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23a1e5-b2e9-4f37-9976-de4e1af455bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:21:02.320998 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23a1e5-b2e9-4f37-9976-de4e1af455bd service nova] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:21:02.331279 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 817/1655] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:21:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:21:12.327110 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=34 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:58.040967 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7bd2b-b045-4d03-9ce5-35e0e4939798 service placement] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:22:58.050318 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7bd2b-b045-4d03-9ce5-35e0e4939798 service placement] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:22:58.053912 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c49b5-aac4-45a4-9646-95c47abb4de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0712574ba8f54b4283c50a74019d315b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:22:58.054553 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c49b5-aac4-45a4-9646-95c47abb4de9 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:22:58.054839 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c49b5-aac4-45a4-9646-95c47abb4de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:22:58.055119 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c49b5-aac4-45a4-9646-95c47abb4de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:22:58.057489 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bd8c49b5-aac4-45a4-9646-95c47abb4de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:22:58.118658 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c49b5-aac4-45a4-9646-95c47abb4de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:22:58.120598 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c49b5-aac4-45a4-9646-95c47abb4de9 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:22:58.130087 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 839/1656] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:23:04.289285 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a1e5-b2e9-4f37-9976-de4e1af455bd service nova] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:23:04.291978 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-9d23a1e5-b2e9-4f37-9976-de4e1af455bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:23:04.307195 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a1e5-b2e9-4f37-9976-de4e1af455bd service nova] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:23:04.311795 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:23:04.312958 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:23:04.313252 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:23:04.313534 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] PATH_INFO: `/v3/users/a83acfc659cc4ba0ac4fb9b009fc2e6e` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:23:04.314757 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a83acfc659cc4ba0ac4fb9b009fc2e6e)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:23:04.315776 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: WARNING py.warnings [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:23:04.315776 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: warnings.warn(msg) Jul 05 10:23:04.315776 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: Jul 05 10:23:04.317009 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:23:04.381547 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a83acfc659cc4ba0ac4fb9b009fc2e6e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.382227 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a83acfc659cc4ba0ac4fb9b009fc2e6e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.382844 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a83acfc659cc4ba0ac4fb9b009fc2e6e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.393832 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a83acfc659cc4ba0ac4fb9b009fc2e6e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.402428 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a83acfc659cc4ba0ac4fb9b009fc2e6e'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.431056 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 818/1657] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 10:23:04 2022] DELETE /identity/v3/users/a83acfc659cc4ba0ac4fb9b009fc2e6e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:23:04.605859 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c49b5-aac4-45a4-9646-95c47abb4de9 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:23:04.617270 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c49b5-aac4-45a4-9646-95c47abb4de9 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:23:04.675390 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:23:04.676264 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:23:04.676546 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:23:04.676823 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] PATH_INFO: `/v3/projects/98919277809c4001b09973988a46e6a4` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:23:04.678039 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=98919277809c4001b09973988a46e6a4)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:23:04.679062 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: WARNING py.warnings [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:23:04.679062 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: warnings.warn(msg) Jul 05 10:23:04.679062 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: Jul 05 10:23:04.680249 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:23:04.732842 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98919277809c4001b09973988a46e6a4', 'request_id': 'req-4a7184db-ef60-444d-9c87-cacdd89aedfc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.745688 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98919277809c4001b09973988a46e6a4', 'request_id': 'req-4a7184db-ef60-444d-9c87-cacdd89aedfc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.753543 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98919277809c4001b09973988a46e6a4', 'request_id': 'req-4a7184db-ef60-444d-9c87-cacdd89aedfc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.765304 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] The token cache is being invalidate because project 98919277809c4001b09973988a46e6a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 10:23:04.765595 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.766237 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.767792 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 840/1658] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 10:23:04 2022] DELETE /identity/v3/projects/98919277809c4001b09973988a46e6a4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:23:04.771752 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:23:04.773171 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:23:04.786159 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddac85-19b5-42e7-bb01-3e91868bb638 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:23:04.840792 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:23:04.841691 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:23:04.841977 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:23:04.842253 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] PATH_INFO: `/v3/users/12621840650f4ae4b342acd3eb3dbc0f` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:23:04.843418 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12621840650f4ae4b342acd3eb3dbc0f)` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:23:04.845762 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:23:04.890265 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12621840650f4ae4b342acd3eb3dbc0f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.890829 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12621840650f4ae4b342acd3eb3dbc0f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.891430 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12621840650f4ae4b342acd3eb3dbc0f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.898074 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12621840650f4ae4b342acd3eb3dbc0f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.905190 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.notifications [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12621840650f4ae4b342acd3eb3dbc0f'} {{(pid=80360) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:04.912817 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:23:04.924862 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 819/1659] 10.222.0.13 () {58 vars in 1223 bytes} [Tue Jul 5 10:23:04 2022] DELETE /identity/v3/users/12621840650f4ae4b342acd3eb3dbc0f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:23:05.092246 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:23:05.093767 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:23:05.109793 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7184db-ef60-444d-9c87-cacdd89aedfc admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:23:05.131803 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:23:05.170049 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88fb21474f844e15aceece6e67aa28d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c453797fe3453cabef5a606e310eef', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:23:05.170845 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:23:05.171129 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:23:05.171407 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] PATH_INFO: `/v3/projects/1fe015354d854330b520d149602e388d` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:23:05.172572 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe015354d854330b520d149602e388d)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:23:05.174525 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:23:05.219978 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe015354d854330b520d149602e388d', 'request_id': 'req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:05.226154 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe015354d854330b520d149602e388d', 'request_id': 'req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:05.233616 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe015354d854330b520d149602e388d', 'request_id': 'req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:05.243826 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] The token cache is being invalidate because project 1fe015354d854330b520d149602e388d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 10:23:05.244119 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:05.245292 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-47a82da4-6cdd-4cc0-813d-0f1e83f3ffac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 10:23:05.246831 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 841/1660] 10.222.0.13 () {58 vars in 1232 bytes} [Tue Jul 5 10:23:05 2022] DELETE /identity/v3/projects/1fe015354d854330b520d149602e388d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 10:23:11.883354 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] Authenticating user token {{(pid=80360) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 10:23:11.885461 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:23:11.952687 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a939a8-ad06-49a9-a6d0-4d0ff5876719 admin admin] Validating token access rules against request {{(pid=80360) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 10:23:12.010498 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5f94e-b5cf-4736-a633-66955d5c96d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df8f75ab3ab4468afdd39e7b8e4793f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44e947a29a74df6acde7e008f714b04', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80360) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 10:23:12.011149 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5f94e-b5cf-4736-a633-66955d5c96d5 service placement] REQUEST_METHOD: `GET` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 10:23:12.011437 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5f94e-b5cf-4736-a633-66955d5c96d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 10:23:12.011719 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5f94e-b5cf-4736-a633-66955d5c96d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80360) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 10:23:12.013512 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.fernet_utils [None req-a4f5f94e-b5cf-4736-a633-66955d5c96d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80360) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 10:23:12.024325 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5f94e-b5cf-4736-a633-66955d5c96d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 10:23:12.025935 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5f94e-b5cf-4736-a633-66955d5c96d5 service placement] RBAC: Authorization granted {{(pid=80360) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 10:23:12.035430 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: [pid: 80360|app: 0|req: 820/1661] 10.222.0.13 () {60 vars in 1365 bytes} [Tue Jul 5 10:23:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 10:23:15.240819 dv-osbrick-master-4-iscsi devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:23:22.031439 dv-osbrick-master-4-iscsi devstack@keystone.service[80360]: DEBUG dbcounter [-] [80360] Writing DB stats keystone:SELECT=61,keystone:DELETE=1 {{(pid=80360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}